Jul 07 08:06:16 devstack cinder-volume[75922]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 08:06:16 devstack cinder-volume[75922]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:06:16 devstack cinder-volume[75922]: we strongly recommend against using it for new projects. Jul 07 08:06:16 devstack cinder-volume[75922]: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:06:16 devstack cinder-volume[75922]: framework. For more detail see Jul 07 08:06:16 devstack cinder-volume[75922]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:06:16 devstack cinder-volume[75922]: import eventlet # noqa Jul 07 08:06:18 devstack cinder-volume[75922]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:06:18 devstack cinder-volume[75922]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:06:18 devstack cinder-volume[75922]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:06:19 devstack cinder-volume[75922]: INFO dbcounter [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Registered counter for database cinder Jul 07 08:06:19 devstack cinder-volume[75922]: DEBUG oslo_db.sqlalchemy.engines [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75922) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:19 devstack cinder-volume[75922]: DEBUG dbcounter [-] [75922] Writer thread running {{(pid=75922) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:06:19 devstack cinder-volume[75922]: INFO cinder.rpc [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 08:06:19 devstack cinder-volume[75922]: INFO cinder.rpc [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 08:06:19 devstack cinder-volume[75922]: DEBUG oslo_db.sqlalchemy.engines [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75922) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:20 devstack cinder-volume[75922]: INFO cinder.volume.manager [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Determined volume DB was empty at startup. Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG cinder.volume.manager [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75922) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 08:06:20 devstack cinder-volume[75922]: INFO cinder.volume.manager [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 08:06:20 devstack cinder-volume[75922]: WARNING stevedore.named [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 08:06:20 devstack cinder-volume[75922]: WARNING castellan.key_manager [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:06:20 devstack cinder-volume[75922]: WARNING cinder.keymgr.conf_key_mgr [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG cinder.volume.drivers.lvm [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75922) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_concurrency.processutils [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75922) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_concurrency.processutils [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] CMD "cinder-rtstool verify" returned: 0 in 0.412s {{(pid=75922) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_db.sqlalchemy.engines [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75922) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:20 devstack cinder-volume[75922]: INFO cinder.rpc [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 08:06:20 devstack cinder-volume[75922]: INFO cinder.rpc [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 08:06:20 devstack cinder-volume[75922]: WARNING stevedore.named [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 08:06:20 devstack cinder-volume[75922]: WARNING castellan.key_manager [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:06:20 devstack cinder-volume[75922]: INFO cinder.volume.manager [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_db.sqlalchemy.engines [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75922) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:20 devstack cinder-volume[75922]: INFO oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Starting 1 workers Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Started child 76098 {{(pid=75922) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Full set of CONF: {{(pid=75922) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] ******************************************************************************** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Configuration options gathered from: {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] ================================================================================ {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] allow_availability_zone_fallback = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] allow_compression_on_image_upload = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] allowed_direct_url_schemes = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] api_rate_limit = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] auth_strategy = keystone {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] az_cache_duration = 3600 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_availability_zone = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_host = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_stats_polling_interval = 60 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backup_api_class = cinder.backup.api.API {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backup_name_template = backup-%s {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backup_use_same_host = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backup_use_temp_snapshot = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] chap_password = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] chap_username = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[76098]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cinder_internal_tenant_project_id = 7a9c0a4b88c04527832dfa479150d09a {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cinder_internal_tenant_user_id = be3d6196775c4f18af59dbbf68fd2d04 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cloned_volume_same_az = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cluster = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] compression_format = gzip {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] compute_api_class = cinder.compute.nova.API {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] config_dir = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] config_source = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] control_exchange = openstack {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] debug = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] default_availability_zone = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] default_group_type = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] default_volume_type = lvmdriver-1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] disk_geometry = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] driver_client_cert = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] driver_client_cert_key = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] driver_data_namespace = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] driver_ssl_cert_path = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] driver_ssl_cert_verify = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] driver_use_ssl = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] enable_force_upload = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] enable_new_services = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] enable_unsupported_driver = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] enabled_backends = ['lvmdriver-1'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] enforce_multipath_for_image_xfer = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] filter_function = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_api_insecure = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_api_ssl_compression = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_ca_certificates_file = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_catalog_info = image:glance:publicURL {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_certfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_keyfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_num_retries = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance_request_timeout = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] goodness_function = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] graceful_shutdown_timeout = 5 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] group_api_class = cinder.group.api.API {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] host = devstack {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_compress_on_upload = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_conversion_address_space_limit = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_conversion_cpu_limit = 60 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_conversion_disable = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_upload_use_cinder_backend = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_upload_use_internal_tenant = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_volume_cache_enabled = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_volume_cache_max_count = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] image_volume_cache_max_size_gb = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] init_host_max_objects_retrieval = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] instance_format = [instance: %(uuid)s] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] iscsi_target_flags = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] iscsi_write_cache = on {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] iser_helper = tgtadm {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] iser_ip_address = 192.168.122.208 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] iser_port = 3260 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] log_color = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] log_config_append = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] log_dir = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] log_file = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] log_options = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] log_rotate_interval = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] log_rotate_interval_type = days {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] log_rotation_type = none {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] max_age = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] max_logfile_count = 30 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] max_logfile_size_mb = 200 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] max_over_subscription_ratio = 20.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] message_reap_interval = 86400 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] message_ttl = 2592000 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] migration_create_volume_timeout_secs = 300 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] monkey_patch = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] monkey_patch_modules = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] my_ip = 192.168.122.208 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] no_snapshot_gb_quota = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] num_iser_scan_tries = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] num_shell_tries = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] num_volume_device_scan_tries = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] nvmeof_conn_info_version = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] nvmet_ns_id = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] nvmet_port_id = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] osapi_max_limit = 1000 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] osapi_volume_ext_list = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] osapi_volume_listen = 0.0.0.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] osapi_volume_listen_port = 8776 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] osapi_volume_use_ssl = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] osapi_volume_workers = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] per_volume_size_limit = -1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] periodic_fuzzy_delay = 60 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] periodic_interval = 60 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] project_id_regex = [0-9a-f\-]+ {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] public_endpoint = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] publish_errors = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] quota_backup_gigabytes = 1000 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] quota_backups = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] quota_gigabytes = 1000 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] quota_groups = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] quota_snapshots = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] quota_volumes = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] rate_limit_burst = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] rate_limit_except_level = CRITICAL {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] rate_limit_interval = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] reinit_driver_count = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] replication_device = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] report_discard_supported = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] report_interval = 120 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] reservation_clean_interval = 86400 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] reservation_expire = 86400 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] reserved_image_namespaces = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] reserved_percentage = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] rpc_response_timeout = 120 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] run_external_periodic_tasks = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] scst_target_driver = iscsi {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] scst_target_iqn_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_down_time = 720 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] shell_completion = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] snapshot_name_template = snapshot-%s {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] snapshot_same_host = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] split_loggers = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] state_path = /opt/stack/data/cinder {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] storage_availability_zone = nova {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] storage_protocol = iSCSI {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] syslog_log_facility = LOG_USER {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] target_helper = lioadm {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] target_ip_address = 192.168.122.208 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] target_port = 3260 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] target_protocol = iscsi {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] target_secondary_ip_addresses = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] trace_flags = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] transfer_api_class = cinder.transfer.api.API {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] transport_url = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] until_refresh = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] use_chap_auth = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] use_default_quota_class = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] use_journal = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] use_json = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] use_multipath_for_image_xfer = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] use_stderr = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] use_syslog = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] verify_glance_signatures = enabled {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_api_class = cinder.volume.api.API {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_backend_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_clear = zero {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_clear_ionice = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_clear_size = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack sudo[76106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_copy_bps_limit = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_dd_blocksize = 1M {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_name_template = volume-%s {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_service_inithost_offload = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:20 devstack sudo[76106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volume_usage_audit_period = month {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] zoning_mode = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_concurrency.disable_process_locking = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.auth_section = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.auth_type = password {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.auth_version = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.cache = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.certfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.delay_auth_decision = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.http_connect_timeout = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.include_service_catalog = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.insecure = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.interface = public {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.keyfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[76098]: INFO cinder.volume.manager [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_password = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcache_username = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.region_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.service_token_roles_required = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.service_type = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.token_cache_time = 300 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.backend = dogpile.cache.null {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.backend_argument = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.backend_expiration_time = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.config_prefix = cache.oslo {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.debug_cache_backend = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.enable_retry_client = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.enable_socket_keepalive = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.enabled = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.expiration_time = 600 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.hashclient_retry_attempts = 2 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.memcache_dead_retry = 300 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.memcache_pool_maxsize = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.memcache_sasl_enabled = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.password = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.proxies = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.redis_db = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.redis_sentinel_service_name = mymaster {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.redis_server = localhost:6379 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.retry_attempts = 2 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.retry_delay = 0.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.socket_keepalive_count = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.socket_keepalive_idle = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.socket_keepalive_interval = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.socket_timeout = 1.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.tls_allowed_ciphers = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.tls_cafile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.tls_certfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.tls_enabled = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.tls_keyfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cache.username = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] coordination.backend_url = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.asyncio_connection = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.asyncio_slave_connection = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.backend = sqlalchemy {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.connection = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.connection_debug = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.connection_parameters = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.connection_recycle_time = 3600 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.connection_trace = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.db_inc_retry_interval = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.db_max_retries = 20 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.db_max_retry_interval = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.db_retry_interval = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.max_overflow = 50 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.max_pool_size = 5 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.max_retries = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.mysql_wsrep_sync_wait = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.pool_timeout = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.retry_interval = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.slave_connection = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.sqlite_synchronous = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.synchronous_reader = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] database.use_db_reconnect = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.connection_string = messaging:// {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.enabled = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.es_doc_type = notification {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.es_scroll_size = 10000 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.es_scroll_time = 2m {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.filter_error_trace = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.hmac_keys = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.sentinel_service_name = mymaster {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.socket_timeout = 0.1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.trace_requests = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler.trace_sqlalchemy = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler_jaeger.process_tags = {} {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler_jaeger.service_name_prefix = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] profiler_otlp.service_name_prefix = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.enforce_new_defaults = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.enforce_scope = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.policy_default_rule = default {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.policy_file = policy.yaml {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_policy.remote_timeout = 60.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] privsep_osbrick.group = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] privsep_osbrick.helper_command = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] privsep_osbrick.user = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cinder_sys_admin.group = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cinder_sys_admin.helper_command = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] cinder_sys_admin.user = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.auth_section = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.auth_type = password {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.cafile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.certfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.collect_timing = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.insecure = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.keyfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.send_service_user_token = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.split_loggers = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] service_user.timeout = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.auth_section = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.auth_type = password {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.certfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.collect_timing = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.insecure = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.keyfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.region_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.split_loggers = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] glance.timeout = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.backend_availability_zone = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.chap_password = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.chap_username = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.disk_geometry = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.driver_client_cert = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.driver_client_cert_key = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.driver_data_namespace = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.driver_use_ssl = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.enable_unsupported_driver = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.extra_capabilities = {} {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.filter_function = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.goodness_function = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.iscsi_target_flags = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.iscsi_write_cache = on {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.iser_helper = tgtadm {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.iser_port = 3260 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.lvm_mirrors = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.lvm_share_target = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.lvm_type = auto {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.num_shell_tries = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.nvmet_port_id = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.replication_device = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.report_discard_supported = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.reserved_percentage = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.scst_target_driver = iscsi {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.scst_target_iqn_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.storage_protocol = iSCSI {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.target_helper = tgtadm {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.target_port = 3260 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.target_protocol = iscsi {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.trace_flags = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.unique_fqdn_network = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.use_chap_auth = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volume_backend_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volume_clear = zero {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volume_clear_ionice = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volume_clear_size = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volume_group = cinder-volumes {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_reports.file_event_handler = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_reports.log_dir = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.backend_availability_zone = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.backend_host = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.chap_password = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.chap_username = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.chiscsi_conf = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.disk_geometry = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.driver_client_cert = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.driver_data_namespace = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.driver_use_ssl = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.extra_capabilities = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.filter_function = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.goodness_function = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.iser_helper = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.iser_ip_address = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.iser_port = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.iser_target_prefix = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.lvm_conf_file = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.lvm_mirrors = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.lvm_share_target = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.lvm_type = auto {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.num_shell_tries = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.nvmet_port_id = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.replication_device = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.report_discard_supported = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.reserved_percentage = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.scst_target_driver = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.storage_protocol = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.target_helper = lioadm {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.target_ip_address = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.target_port = 3260 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.target_protocol = iscsi {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.trace_flags = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.use_chap_auth = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volume_clear = zero {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volume_clear_size = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.083s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] lvmdriver-1.volumes_dir = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.ssl = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack sudo[76106]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.ssl_version = {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_notifications.driver = [] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_notifications.retry = -1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] oslo_messaging_notifications.transport_url = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack sudo[76112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] key_manager.fixed_key = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.barbican_api_version = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.barbican_endpoint = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.barbican_endpoint_type = public {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.barbican_region_name = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.cafile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack sudo[76112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.certfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.collect_timing = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.insecure = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.keyfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.number_of_retries = 60 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.retry_delay = 1 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.send_service_user_token = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.split_loggers = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.timeout = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.verify_ssl = True {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican.verify_ssl_path = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican_service_user.auth_section = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican_service_user.auth_type = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican_service_user.cafile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican_service_user.certfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican_service_user.collect_timing = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican_service_user.insecure = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican_service_user.keyfile = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican_service_user.split_loggers = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] barbican_service_user.timeout = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.approle_role_id = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.approle_secret_id = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.kv_mountpoint = secret {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.kv_path = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.kv_version = 2 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.namespace = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.root_token_id = **** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.ssl_ca_crt_file = None {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.timeout = 60.0 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.use_ssl = False {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:06:21 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] ******************************************************************************** {{(pid=75922) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 08:06:21 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.767s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:21 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:22 devstack sudo[76112]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:22 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.638s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:22 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:06:22 devstack cinder-volume[76098]: INFO cinder.brick.local_dev.lvm [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 08:06:22 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:22 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:22 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:22 devstack sudo[76273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:22 devstack sudo[76273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:23 devstack sudo[76273]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:23 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:23 devstack cinder-volume[76098]: DEBUG cinder.brick.local_dev.lvm [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76098) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 08:06:23 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:23 devstack sudo[76477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:23 devstack sudo[76477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:24 devstack sudo[76477]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:24 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.756s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:24 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:24 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:24 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:24 devstack sudo[76846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:24 devstack sudo[76846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:25 devstack sudo[76846]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:25 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.704s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:25 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:25 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:25 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:25 devstack sudo[76888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 08:06:25 devstack sudo[76888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:26 devstack sudo[76888]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:26 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.706s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:26 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:26 devstack sudo[76892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:26 devstack sudo[76892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:26 devstack sudo[76892]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:26 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:26 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:26 devstack sudo[76904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:26 devstack sudo[76904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:27 devstack sudo[76904]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:27 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.710s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:27 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:27 devstack sudo[76908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:27 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:28 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:28 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:28 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:28 devstack sudo[76914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:28 devstack sudo[76914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:29 devstack sudo[76914]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:29 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.789s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:29 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:29 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:29 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:29 devstack sudo[76920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:29 devstack sudo[76920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:29 devstack sudo[76920]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:29 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.719s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:29 devstack cinder-volume[76098]: INFO cinder.volume.drivers.lvm [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 08:06:29 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:29 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:29 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:29 devstack sudo[76928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:29 devstack sudo[76928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:30 devstack cinder-volume[75922]: DEBUG dbcounter [-] [75922] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75922) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:06:30 devstack sudo[76928]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:30 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.849s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:30 devstack cinder-volume[76098]: DEBUG cinder.volume.drivers.lvm [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Updating volume stats {{(pid=76098) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:06:30 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:30 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:30 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:31 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:31 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:31 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:31 devstack sudo[77054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:31 devstack sudo[77054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:31 devstack sudo[77054]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:31 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:31 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:31 devstack sudo[77194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:31 devstack sudo[77194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:32 devstack sudo[77194]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:32 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:32 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:32 devstack sudo[77197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:32 devstack sudo[77197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:33 devstack sudo[77197]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:33 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:33 devstack cinder-volume[76098]: INFO cinder.volume.driver [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 08:06:33 devstack cinder-volume[76098]: DEBUG cinder.volume.driver [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76098) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 08:06:33 devstack cinder-volume[76098]: DEBUG oslo_db.sqlalchemy.engines [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76098) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:06:33 devstack cinder-volume[76098]: DEBUG dbcounter [-] [76098] Writer thread running {{(pid=76098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:06:33 devstack cinder-volume[76098]: DEBUG cinder.db.api [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Building query based on filter {{(pid=76098) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 08:06:33 devstack cinder-volume[76098]: DEBUG cinder.image.image_utils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76098) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 08:06:33 devstack cinder-volume[76098]: INFO cinder.keymgr.migration [None req-1d9b8314-433d-412a-b086-59fc2ff9e443 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 08:06:33 devstack cinder-volume[76098]: DEBUG cinder.volume.drivers.lvm [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Updating volume stats {{(pid=76098) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:06:33 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:33 devstack sudo[77201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:33 devstack sudo[77201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:34 devstack sudo[77201]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:34 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:34 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:34 devstack sudo[77208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:34 devstack sudo[77208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:34 devstack sudo[77208]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:34 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:34 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:34 devstack sudo[77212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:34 devstack sudo[77212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:35 devstack sudo[77212]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:35 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:35 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:35 devstack sudo[77215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:35 devstack sudo[77215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:36 devstack sudo[77215]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:36 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:36 devstack cinder-volume[76098]: DEBUG cinder.manager [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Notifying Schedulers of capabilities ... {{(pid=76098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:06:36 devstack cinder-volume[76098]: INFO cinder.volume.manager [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Driver initialization completed successfully. Jul 07 08:06:36 devstack cinder-volume[76098]: INFO cinder.manager [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Initiating service 2 cleanup Jul 07 08:06:36 devstack cinder-volume[76098]: INFO cinder.manager [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Service 2 cleanup completed. Jul 07 08:06:36 devstack cinder-volume[76098]: DEBUG cinder.service [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Creating RPC server for service cinder-volume {{(pid=76098) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 08:06:36 devstack cinder-volume[76098]: DEBUG cinder.service [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76098) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 08:06:36 devstack cinder-volume[76098]: INFO cinder.volume.manager [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 08:06:36 devstack cinder-volume[76098]: DEBUG cinder.volume.drivers.lvm [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Updating volume stats {{(pid=76098) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:06:36 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:36 devstack sudo[77219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:06:36 devstack sudo[77219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:36 devstack sudo[77219]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:36 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:36 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:36 devstack sudo[77223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:37 devstack sudo[77223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:37 devstack sudo[77223]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:37 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:37 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:37 devstack sudo[77230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:06:37 devstack sudo[77230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:38 devstack sudo[77230]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:38 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:38 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:06:38 devstack sudo[77233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:06:38 devstack sudo[77233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:06:38 devstack sudo[77233]: pam_unix(sudo:session): session closed for user root Jul 07 08:06:38 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:06:38 devstack cinder-volume[76098]: INFO cinder.volume.manager [None req-ece380a5-3070-4b93-8312-9cc870a57386 None None] Driver post RPC initialization completed successfully. Jul 07 08:06:48 devstack cinder-volume[76098]: DEBUG dbcounter [-] [76098] Writing DB stats cinder:SELECT=3 {{(pid=76098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:06:49 devstack cinder-volume[76098]: DEBUG dbcounter [-] [76098] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:07:06 devstack cinder-volume[76098]: DEBUG oslo_service.periodic_task [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running periodic task VolumeManager._thread_info {{(pid=76098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:07:06 devstack cinder-volume[76098]: DEBUG cinder.volume.manager [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] thread count: 6 {{(pid=76098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:07:06 devstack cinder-volume[76098]: DEBUG cinder.volume.manager [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] thread info: [<_MainThread(MainThread, started 131836834742400)>, , , , , ] {{(pid=76098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:08:06 devstack cinder-volume[76098]: DEBUG oslo_service.periodic_task [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:08:06 devstack cinder-volume[76098]: DEBUG cinder.volume.drivers.lvm [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Updating volume stats {{(pid=76098) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:08:06 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:08:06 devstack sudo[79804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:08:06 devstack sudo[79804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:08:07 devstack sudo[79804]: pam_unix(sudo:session): session closed for user root Jul 07 08:08:07 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:08:07 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:08:07 devstack sudo[80201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:08:07 devstack sudo[80201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:08:08 devstack sudo[80201]: pam_unix(sudo:session): session closed for user root Jul 07 08:08:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:08:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:08:08 devstack sudo[80556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:08:08 devstack sudo[80556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:08:08 devstack sudo[80556]: pam_unix(sudo:session): session closed for user root Jul 07 08:08:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:08:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:08:08 devstack sudo[80930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:08:08 devstack sudo[80930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:08:09 devstack sudo[80930]: pam_unix(sudo:session): session closed for user root Jul 07 08:08:09 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:08:09 devstack cinder-volume[76098]: DEBUG cinder.manager [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Notifying Schedulers of capabilities ... {{(pid=76098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:08:09 devstack cinder-volume[76098]: DEBUG oslo_service.periodic_task [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running periodic task VolumeManager._thread_info {{(pid=76098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:08:09 devstack cinder-volume[76098]: DEBUG cinder.volume.manager [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] thread count: 6 {{(pid=76098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:08:09 devstack cinder-volume[76098]: DEBUG cinder.volume.manager [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] thread info: [<_MainThread(MainThread, started 131836834742400)>, , , , , ] {{(pid=76098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:08:48 devstack cinder-volume[76098]: DEBUG dbcounter [-] [76098] Writing DB stats cinder:SELECT=1 {{(pid=76098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:08:48 devstack cinder-volume[76098]: DEBUG dbcounter [-] [76098] Writing DB stats cinder:UPDATE=1 {{(pid=76098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:09:06 devstack cinder-volume[76098]: DEBUG oslo_service.periodic_task [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:09:06 devstack cinder-volume[76098]: DEBUG cinder.volume.drivers.lvm [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Updating volume stats {{(pid=76098) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:09:06 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:09:06 devstack sudo[83459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:09:06 devstack sudo[83459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:09:07 devstack sudo[83459]: pam_unix(sudo:session): session closed for user root Jul 07 08:09:07 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:09:07 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:09:07 devstack sudo[83510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:09:07 devstack sudo[83510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:09:08 devstack sudo[83510]: pam_unix(sudo:session): session closed for user root Jul 07 08:09:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:09:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:09:08 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:09:08 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:09:08 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Jul 07 08:09:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.678s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:09:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:09:08 devstack sudo[83574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:09:08 devstack sudo[83574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:09:09 devstack sudo[83574]: pam_unix(sudo:session): session closed for user root Jul 07 08:09:09 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:09:09 devstack cinder-volume[76098]: DEBUG cinder.manager [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Notifying Schedulers of capabilities ... {{(pid=76098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:09:09 devstack cinder-volume[76098]: DEBUG oslo_service.periodic_task [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running periodic task VolumeManager._thread_info {{(pid=76098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:09:09 devstack cinder-volume[76098]: DEBUG cinder.volume.manager [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] thread count: 6 {{(pid=76098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:09:09 devstack cinder-volume[76098]: DEBUG cinder.volume.manager [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] thread info: [<_MainThread(MainThread, started 131836834742400)>, , , , , ] {{(pid=76098) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:10:06 devstack cinder-volume[76098]: DEBUG oslo_service.periodic_task [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76098) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:10:06 devstack cinder-volume[76098]: DEBUG cinder.volume.drivers.lvm [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Updating volume stats {{(pid=76098) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 08:10:06 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:10:07 devstack sudo[85051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 08:10:07 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:10:07 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root Jul 07 08:10:07 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:10:07 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:10:07 devstack sudo[85061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:10:07 devstack sudo[85061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:10:08 devstack sudo[85061]: pam_unix(sudo:session): session closed for user root Jul 07 08:10:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:10:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:10:08 devstack sudo[85082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 08:10:08 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:10:08 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root Jul 07 08:10:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:10:08 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:10:09 devstack sudo[85098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 08:10:09 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:10:09 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root Jul 07 08:10:09 devstack cinder-volume[76098]: DEBUG oslo_concurrency.processutils [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76098) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:10:09 devstack cinder-volume[76098]: DEBUG cinder.manager [None req-d3d73859-5bc4-4d0b-aa87-1bd0ab757615 None None] Notifying Schedulers of capabilities ... {{(pid=76098) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:10:48 devstack cinder-volume[76098]: DEBUG dbcounter [-] [76098] Writing DB stats cinder:SELECT=1 {{(pid=76098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:10:48 devstack cinder-volume[76098]: DEBUG dbcounter [-] [76098] Writing DB stats cinder:UPDATE=1 {{(pid=76098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:10:58 devstack cinder-volume[75922]: INFO oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Caught SIGTERM, stopping children Jul 07 08:10:58 devstack cinder-volume[75922]: DEBUG oslo_concurrency.lockutils [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Acquiring lock "singleton_lock" {{(pid=75922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:10:58 devstack cinder-volume[75922]: DEBUG oslo_concurrency.lockutils [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Acquired lock "singleton_lock" {{(pid=75922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:10:58 devstack cinder-volume[75922]: DEBUG oslo_concurrency.lockutils [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Releasing lock "singleton_lock" {{(pid=75922) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:10:58 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Stop services. {{(pid=75922) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 08:10:58 devstack cinder-volume[75922]: DEBUG oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Killing children. {{(pid=75922) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 08:10:58 devstack cinder-volume[75922]: INFO oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Waiting on 1 children to exit Jul 07 08:11:01 devstack cinder-volume[76098]: DEBUG oslo_concurrency.lockutils [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Acquiring lock "singleton_lock" {{(pid=76098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:11:01 devstack cinder-volume[76098]: DEBUG oslo_concurrency.lockutils [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Acquired lock "singleton_lock" {{(pid=76098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:11:01 devstack cinder-volume[76098]: DEBUG oslo_concurrency.lockutils [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Releasing lock "singleton_lock" {{(pid=76098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:11:01 devstack cinder-volume[76098]: WARNING amqp [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 08:11:01 devstack cinder-volume[76098]: WARNING amqp [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 08:11:01 devstack cinder-volume[75922]: INFO oslo_service.backend._eventlet.service [None req-2db399f4-3da3-42c1-afd0-a29972a1cfac None None] Child 76098 exited with status 0 Jul 07 08:11:01 devstack cinder-volume[86217]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 08:11:01 devstack cinder-volume[86217]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:11:01 devstack cinder-volume[86217]: we strongly recommend against using it for new projects. Jul 07 08:11:01 devstack cinder-volume[86217]: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:11:01 devstack cinder-volume[86217]: framework. For more detail see Jul 07 08:11:01 devstack cinder-volume[86217]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:11:01 devstack cinder-volume[86217]: import eventlet # noqa Jul 07 08:11:03 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:11:03 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:11:03 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:11:04 devstack cinder-volume[86217]: INFO dbcounter [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Registered counter for database cinder Jul 07 08:11:04 devstack cinder-volume[86217]: DEBUG oslo_db.sqlalchemy.engines [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86217) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:04 devstack cinder-volume[86217]: DEBUG dbcounter [-] [86217] Writer thread running {{(pid=86217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:11:04 devstack cinder-volume[86217]: INFO cinder.rpc [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 08:11:04 devstack cinder-volume[86217]: INFO cinder.rpc [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 08:11:04 devstack cinder-volume[86217]: DEBUG oslo_db.sqlalchemy.engines [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86217) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:05 devstack cinder-volume[86217]: INFO cinder.volume.manager [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Determined volume DB was empty at startup. Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG cinder.volume.manager [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86217) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 08:11:05 devstack cinder-volume[86217]: INFO cinder.volume.manager [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 08:11:05 devstack cinder-volume[86217]: WARNING stevedore.named [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 08:11:05 devstack cinder-volume[86217]: WARNING castellan.key_manager [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:11:05 devstack cinder-volume[86217]: WARNING cinder.keymgr.conf_key_mgr [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:11:05 devstack cinder-volume[86217]: INFO cinder.volume.manager [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_db.sqlalchemy.engines [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86217) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:05 devstack cinder-volume[86217]: INFO oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Starting 1 workers Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Started child 86436 {{(pid=86217) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Full set of CONF: {{(pid=86217) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] ******************************************************************************** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Configuration options gathered from: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 08:11:05 devstack cinder-volume[86436]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] ================================================================================ {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] allow_availability_zone_fallback = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] allow_compression_on_image_upload = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] allowed_direct_url_schemes = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] api_rate_limit = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] auth_strategy = keystone {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_availability_zone = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_host = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_stats_polling_interval = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backup_api_class = cinder.backup.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backup_name_template = backup-%s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backup_use_same_host = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backup_use_temp_snapshot = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] chap_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] chap_username = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cinder_internal_tenant_project_id = 7a9c0a4b88c04527832dfa479150d09a {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cinder_internal_tenant_user_id = be3d6196775c4f18af59dbbf68fd2d04 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cluster = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] compression_format = gzip {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] compute_api_class = cinder.compute.nova.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] config_dir = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] config_source = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] control_exchange = openstack {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] debug = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] default_availability_zone = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] default_group_type = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] default_volume_type = QuobyteHD {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] disk_geometry = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] driver_client_cert = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] driver_client_cert_key = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] driver_data_namespace = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] driver_ssl_cert_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] driver_ssl_cert_verify = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] driver_use_ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] enable_new_services = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] enable_unsupported_driver = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] enabled_backends = ['QuobyteHD'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] enforce_multipath_for_image_xfer = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] filter_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_api_insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_api_ssl_compression = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_ca_certificates_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_catalog_info = image:glance:publicURL {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_num_retries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance_request_timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] goodness_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] graceful_shutdown_timeout = 5 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] group_api_class = cinder.group.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] host = devstack {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_compress_on_upload = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_conversion_address_space_limit = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_conversion_cpu_limit = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_conversion_disable = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_upload_use_cinder_backend = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_upload_use_internal_tenant = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_volume_cache_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_volume_cache_max_count = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] image_volume_cache_max_size_gb = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] init_host_max_objects_retrieval = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] instance_format = [instance: %(uuid)s] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] iscsi_target_flags = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] iscsi_write_cache = on {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] iser_helper = tgtadm {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] iser_ip_address = 192.168.122.208 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] iser_port = 3260 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86436]: INFO cinder.volume.manager [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] log_color = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] log_config_append = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] log_dir = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] log_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] log_options = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] log_rotate_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] log_rotate_interval_type = days {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] log_rotation_type = none {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.remotefs [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86436) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] max_age = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] max_logfile_count = 30 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] max_logfile_size_mb = 200 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] max_over_subscription_ratio = 20.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] message_reap_interval = 86400 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] message_ttl = 2592000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] migration_create_volume_timeout_secs = 300 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] monkey_patch = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] monkey_patch_modules = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] my_ip = 192.168.122.208 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] no_snapshot_gb_quota = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] num_iser_scan_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] num_shell_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] num_volume_device_scan_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] nvmeof_conn_info_version = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] nvmet_ns_id = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] nvmet_port_id = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] osapi_max_limit = 1000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] osapi_volume_ext_list = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] osapi_volume_listen_port = 8776 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] osapi_volume_use_ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] osapi_volume_workers = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] per_volume_size_limit = -1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] periodic_fuzzy_delay = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] periodic_interval = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] public_endpoint = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] publish_errors = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] quota_backup_gigabytes = 1000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] quota_backups = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] quota_gigabytes = 1000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] quota_groups = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] quota_snapshots = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] quota_volumes = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] rate_limit_burst = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] rate_limit_except_level = CRITICAL {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] rate_limit_interval = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] reinit_driver_count = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] replication_device = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] report_discard_supported = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] report_interval = 120 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] reservation_clean_interval = 86400 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] reservation_expire = 86400 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] reserved_image_namespaces = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] reserved_percentage = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] rpc_response_timeout = 120 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] run_external_periodic_tasks = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] scst_target_driver = iscsi {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] scst_target_iqn_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_down_time = 720 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] shell_completion = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] snapshot_name_template = snapshot-%s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] state_path = /opt/stack/data/cinder {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] storage_availability_zone = nova {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] storage_protocol = iSCSI {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] syslog_log_facility = LOG_USER {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] target_helper = lioadm {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] target_ip_address = 192.168.122.208 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] target_port = 3260 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] target_protocol = iscsi {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] target_secondary_ip_addresses = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] trace_flags = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] transport_url = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] until_refresh = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] use_chap_auth = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] use_default_quota_class = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] use_journal = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] use_json = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] use_multipath_for_image_xfer = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] use_stderr = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] use_syslog = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] verify_glance_signatures = enabled {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_api_class = cinder.volume.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_backend_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_clear = zero {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_clear_ionice = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_clear_size = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_copy_bps_limit = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_dd_blocksize = 1M {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_name_template = volume-%s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_service_inithost_offload = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volume_usage_audit_period = month {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] zoning_mode = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_concurrency.disable_process_locking = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.auth_section = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.auth_type = password {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.auth_version = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.cache = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.include_service_catalog = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.interface = public {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_password = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcache_username = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.region_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.service_type = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.backend = dogpile.cache.null {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.backend_argument = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.backend_expiration_time = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.config_prefix = cache.oslo {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.debug_cache_backend = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.enable_retry_client = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.enable_socket_keepalive = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.expiration_time = 600 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.hashclient_retry_attempts = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.memcache_dead_retry = 300 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.memcache_pool_maxsize = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.memcache_sasl_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.proxies = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.redis_db = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.redis_server = localhost:6379 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.retry_attempts = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.retry_delay = 0.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.socket_keepalive_count = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.socket_keepalive_idle = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.socket_keepalive_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.socket_timeout = 1.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.tls_allowed_ciphers = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.tls_cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.tls_certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.tls_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.tls_keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cache.username = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] coordination.backend_url = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.asyncio_connection = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.asyncio_slave_connection = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.backend = sqlalchemy {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.connection = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.connection_debug = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.connection_parameters = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.connection_recycle_time = 3600 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.connection_trace = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.db_inc_retry_interval = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.db_max_retries = 20 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.db_max_retry_interval = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.db_retry_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.max_overflow = 50 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.max_pool_size = 5 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.max_retries = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.mysql_wsrep_sync_wait = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.pool_timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.retry_interval = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.slave_connection = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.sqlite_synchronous = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.synchronous_reader = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] database.use_db_reconnect = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.connection_string = messaging:// {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.es_doc_type = notification {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.es_scroll_size = 10000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.es_scroll_time = 2m {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.filter_error_trace = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.hmac_keys = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.sentinel_service_name = mymaster {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.socket_timeout = 0.1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.trace_requests = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler.trace_sqlalchemy = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler_jaeger.process_tags = {} {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler_jaeger.service_name_prefix = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] profiler_otlp.service_name_prefix = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.enforce_new_defaults = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.enforce_scope = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.policy_default_rule = default {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.policy_file = policy.yaml {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] privsep_osbrick.group = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] privsep_osbrick.helper_command = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] privsep_osbrick.user = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86436) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cinder_sys_admin.group = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86436]: WARNING cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 08:11:05 devstack cinder-volume[86436]: WARNING cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cinder_sys_admin.helper_command = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Running cmd (subprocess): mount.quobyte {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] cinder_sys_admin.user = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.auth_section = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.auth_type = password {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.collect_timing = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.send_service_user_token = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] service_user.timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.auth_section = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.auth_type = password {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.collect_timing = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.region_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] glance.timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.backend_availability_zone = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.chap_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.chap_username = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.disk_geometry = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.driver_client_cert = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.driver_client_cert_key = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.driver_data_namespace = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.driver_use_ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.extra_capabilities = {} {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.filter_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.goodness_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.iscsi_target_flags = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.iscsi_write_cache = on {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.iser_helper = tgtadm {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.iser_port = 3260 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_host = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_login = admin {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_mount_options = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_private_key = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_share_path = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.num_shell_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.quobyte_volume_url = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.replication_device = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.report_discard_supported = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.reserved_percentage = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.target_helper = tgtadm {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.target_port = 3260 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.target_protocol = iscsi {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.trace_flags = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.unique_fqdn_network = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.use_chap_auth = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.volume_backend_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.volume_clear = zero {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.volume_clear_ionice = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.volume_clear_size = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_reports.file_event_handler = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_reports.log_dir = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.backend_availability_zone = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.backend_host = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.chap_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.chap_username = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.chiscsi_conf = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.disk_geometry = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.driver_client_cert = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.driver_data_namespace = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.driver_use_ssl = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.extra_capabilities = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.filter_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.goodness_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.iser_helper = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.iser_ip_address = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.iser_port = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.iser_target_prefix = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_host = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_login = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_mount_options = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_private_key = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_share_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_ssh_port = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.num_shell_tries = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.nvmet_port_id = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.replication_device = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.report_discard_supported = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.reserved_percentage = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.scst_target_driver = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.storage_protocol = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.target_helper = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.target_ip_address = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.target_port = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.target_prefix = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.target_protocol = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.trace_flags = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.use_chap_auth = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.volume_clear = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.volume_clear_size = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] QuobyteHD.volumes_dir = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_notifications.driver = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_notifications.retry = -1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] key_manager.fixed_key = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.barbican_api_version = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.barbican_endpoint = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.barbican_endpoint_type = public {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.barbican_region_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.collect_timing = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.number_of_retries = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.retry_delay = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.send_service_user_token = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.verify_ssl = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican.verify_ssl_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican_service_user.auth_section = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican_service_user.auth_type = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican_service_user.cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican_service_user.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican_service_user.collect_timing = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican_service_user.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican_service_user.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican_service_user.split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] barbican_service_user.timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.approle_role_id = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.approle_secret_id = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.kv_mountpoint = secret {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.kv_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.kv_version = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.namespace = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.root_token_id = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.ssl_ca_crt_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.timeout = 60.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.use_ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:05 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] ******************************************************************************** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 08:11:05 devstack quobyte-client[86441]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 08:11:05 devstack quobyte-client[86441]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 08:11:05 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:05 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:05 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:05 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=86436) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:05 devstack cinder-volume[86436]: INFO cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 ... Jul 07 08:11:05 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 -c /etc/quobyte/client-cinder.cfg {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:05 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 -c /etc/quobyte/client-cinder.cfg Jul 07 08:11:05 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:06 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:06 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.764s {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:06 devstack cinder-volume[86436]: INFO cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 succeeded Jul 07 08:11:06 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=86436) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:06 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.777s {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:06 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:06 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:11:06 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:06 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:06 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.611s {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:06 devstack cinder-volume[86436]: INFO cinder.volume.driver [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Driver hasn't implemented _init_vendor_properties() Jul 07 08:11:06 devstack cinder-volume[86436]: DEBUG cinder.volume.driver [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86436) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_db.sqlalchemy.engines [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG dbcounter [-] [86436] Writer thread running {{(pid=86436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG cinder.db.api [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Building query based on filter {{(pid=86436) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG cinder.image.image_utils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86436) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 08:11:07 devstack cinder-volume[86436]: INFO cinder.keymgr.migration [None req-f15c3836-c74d-4a6f-9a22-513165eac884 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=86436) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=86436) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:07 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:11:07 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:07 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.617s {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG cinder.manager [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Notifying Schedulers of capabilities ... {{(pid=86436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:11:07 devstack cinder-volume[86436]: INFO cinder.volume.manager [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Driver initialization completed successfully. Jul 07 08:11:07 devstack cinder-volume[86436]: INFO cinder.manager [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Initiating service 3 cleanup Jul 07 08:11:07 devstack cinder-volume[86436]: INFO cinder.manager [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Service 3 cleanup completed. Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG cinder.service [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Creating RPC server for service cinder-volume {{(pid=86436) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG cinder.service [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86436) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 08:11:07 devstack cinder-volume[86436]: INFO cinder.volume.manager [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=86436) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.quobyte [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=86436) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:07 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:07 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:11:07 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:08 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:08 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.688s {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:08 devstack cinder-volume[86436]: INFO cinder.volume.manager [None req-3f0781ae-5c28-4efc-9f53-6a0f0276e17f None None] Driver post RPC initialization completed successfully. Jul 07 08:11:12 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-8b131ae8-aa49-4e42-bcf3-976e3cf3cd89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:12 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-8b131ae8-aa49-4e42-bcf3-976e3cf3cd89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:12 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.quobyte [None req-8b131ae8-aa49-4e42-bcf3-976e3cf3cd89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=86436) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:12 devstack cinder-volume[86436]: DEBUG cinder.volume.drivers.quobyte [None req-8b131ae8-aa49-4e42-bcf3-976e3cf3cd89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=86436) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:12 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-8b131ae8-aa49-4e42-bcf3-976e3cf3cd89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86436) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:12 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-8b131ae8-aa49-4e42-bcf3-976e3cf3cd89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:12 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:11:12 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:13 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:13 devstack cinder-volume[86436]: DEBUG oslo_concurrency.processutils [None req-8b131ae8-aa49-4e42-bcf3-976e3cf3cd89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.614s {{(pid=86436) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:13 devstack cinder-volume[86436]: DEBUG cinder.manager [None req-8b131ae8-aa49-4e42-bcf3-976e3cf3cd89 None None] Notifying Schedulers of capabilities ... {{(pid=86436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:11:15 devstack cinder-volume[86217]: DEBUG dbcounter [-] [86217] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:11:15 devstack cinder-volume[86217]: INFO oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Caught SIGTERM, stopping children Jul 07 08:11:15 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Acquiring lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:11:15 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Acquired lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:11:15 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Releasing lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:11:15 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Stop services. {{(pid=86217) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 08:11:15 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Killing children. {{(pid=86217) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 08:11:15 devstack cinder-volume[86217]: INFO oslo_service.backend._eventlet.service [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Waiting on 1 children to exit Jul 07 08:11:18 devstack cinder-volume[86436]: DEBUG dbcounter [-] [86436] Writing DB stats cinder:SELECT=4 {{(pid=86436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:11:18 devstack cinder-volume[86436]: DEBUG dbcounter [-] [86436] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86436) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:11:20 devstack cinder-volume[86436]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 07 08:11:21 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Acquiring lock "singleton_lock" {{(pid=86436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:11:21 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Acquired lock "singleton_lock" {{(pid=86436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:11:21 devstack cinder-volume[86436]: DEBUG oslo_concurrency.lockutils [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Releasing lock "singleton_lock" {{(pid=86436) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:11:21 devstack cinder-volume[86436]: WARNING amqp [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 08:11:21 devstack cinder-volume[86436]: WARNING amqp [None req-f8bbbe8c-9738-4d40-816e-26e19854d2cc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 08:11:21 devstack cinder-volume[86918]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 08:11:21 devstack cinder-volume[86918]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:11:21 devstack cinder-volume[86918]: we strongly recommend against using it for new projects. Jul 07 08:11:21 devstack cinder-volume[86918]: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:11:21 devstack cinder-volume[86918]: framework. For more detail see Jul 07 08:11:21 devstack cinder-volume[86918]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:11:21 devstack cinder-volume[86918]: import eventlet # noqa Jul 07 08:11:23 devstack cinder-volume[86918]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 08:11:23 devstack cinder-volume[86918]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 08:11:23 devstack cinder-volume[86918]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 08:11:24 devstack cinder-volume[86918]: INFO dbcounter [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Registered counter for database cinder Jul 07 08:11:24 devstack cinder-volume[86918]: DEBUG oslo_db.sqlalchemy.engines [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86918) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:24 devstack cinder-volume[86918]: DEBUG dbcounter [-] [86918] Writer thread running {{(pid=86918) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:11:24 devstack cinder-volume[86918]: INFO cinder.rpc [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 08:11:24 devstack cinder-volume[86918]: INFO cinder.rpc [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_db.sqlalchemy.engines [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86918) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:25 devstack cinder-volume[86918]: INFO cinder.volume.manager [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Determined volume DB was empty at startup. Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG cinder.volume.manager [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86918) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 08:11:25 devstack cinder-volume[86918]: WARNING stevedore.named [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 08:11:25 devstack cinder-volume[86918]: WARNING castellan.key_manager [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:11:25 devstack cinder-volume[86918]: WARNING cinder.keymgr.conf_key_mgr [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 08:11:25 devstack cinder-volume[86918]: INFO cinder.volume.manager [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_db.sqlalchemy.engines [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86918) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:25 devstack cinder-volume[86918]: INFO oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Starting 1 workers Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Started child 87179 {{(pid=86918) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Full set of CONF: {{(pid=86918) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] ******************************************************************************** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] Configuration options gathered from: {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] ================================================================================ {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 08:11:25 devstack cinder-volume[87179]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] allow_availability_zone_fallback = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] allow_compression_on_image_upload = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] allowed_direct_url_schemes = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] api_rate_limit = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] auth_strategy = keystone {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_availability_zone = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_host = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_stats_polling_interval = 60 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backup_api_class = cinder.backup.api.API {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backup_name_template = backup-%s {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backup_use_same_host = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backup_use_temp_snapshot = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] chap_password = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] chap_username = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cinder_internal_tenant_project_id = 7a9c0a4b88c04527832dfa479150d09a {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cinder_internal_tenant_user_id = be3d6196775c4f18af59dbbf68fd2d04 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cluster = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] compression_format = gzip {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] compute_api_class = cinder.compute.nova.API {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] config_dir = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] config_source = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] control_exchange = openstack {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] debug = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] default_availability_zone = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] default_group_type = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] default_volume_type = QuobyteHD {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] disk_geometry = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] driver_client_cert = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] driver_client_cert_key = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] driver_data_namespace = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] driver_ssl_cert_path = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] driver_ssl_cert_verify = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] driver_use_ssl = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] enable_new_services = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] enable_unsupported_driver = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] enabled_backends = ['QuobyteHD'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] enforce_multipath_for_image_xfer = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] filter_function = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_api_insecure = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_api_ssl_compression = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_ca_certificates_file = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_catalog_info = image:glance:publicURL {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_certfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_keyfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_num_retries = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance_request_timeout = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] goodness_function = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] graceful_shutdown_timeout = 5 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] group_api_class = cinder.group.api.API {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] host = devstack {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_compress_on_upload = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_conversion_address_space_limit = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_conversion_cpu_limit = 60 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_conversion_disable = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_upload_use_cinder_backend = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_upload_use_internal_tenant = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_volume_cache_enabled = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_volume_cache_max_count = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] image_volume_cache_max_size_gb = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] init_host_max_objects_retrieval = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] instance_format = [instance: %(uuid)s] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] iscsi_target_flags = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] iscsi_write_cache = on {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] iser_helper = tgtadm {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] iser_ip_address = 192.168.122.208 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] iser_port = 3260 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] log_color = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] log_config_append = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] log_dir = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] log_file = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] log_options = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] log_rotate_interval = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] log_rotate_interval_type = days {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] log_rotation_type = none {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] max_age = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] max_logfile_count = 30 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] max_logfile_size_mb = 200 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] max_over_subscription_ratio = 20.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] message_reap_interval = 86400 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] message_ttl = 2592000 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] migration_create_volume_timeout_secs = 300 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] monkey_patch = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87179) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] monkey_patch_modules = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] my_ip = 192.168.122.208 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] no_snapshot_gb_quota = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] num_iser_scan_tries = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] num_shell_tries = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] num_volume_device_scan_tries = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] nvmeof_conn_info_version = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] nvmet_ns_id = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] nvmet_port_id = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] osapi_max_limit = 1000 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] osapi_volume_ext_list = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] osapi_volume_listen_port = 8776 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] osapi_volume_use_ssl = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] osapi_volume_workers = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] per_volume_size_limit = -1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] periodic_fuzzy_delay = 60 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] periodic_interval = 60 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] public_endpoint = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] publish_errors = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] quota_backup_gigabytes = 1000 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] quota_backups = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] quota_gigabytes = 1000 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] quota_groups = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] quota_snapshots = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] quota_volumes = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] rate_limit_burst = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] rate_limit_except_level = CRITICAL {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] rate_limit_interval = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] reinit_driver_count = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] replication_device = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] report_discard_supported = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] report_interval = 120 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] reservation_clean_interval = 86400 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] reservation_expire = 86400 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] reserved_image_namespaces = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] reserved_percentage = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] rpc_response_timeout = 120 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] run_external_periodic_tasks = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] scst_target_driver = iscsi {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] scst_target_iqn_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_down_time = 720 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] shell_completion = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] snapshot_name_template = snapshot-%s {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] split_loggers = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] state_path = /opt/stack/data/cinder {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] storage_availability_zone = nova {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] storage_protocol = iSCSI {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] syslog_log_facility = LOG_USER {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] target_helper = lioadm {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] target_ip_address = 192.168.122.208 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] target_port = 3260 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] target_protocol = iscsi {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] target_secondary_ip_addresses = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] trace_flags = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] transport_url = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] until_refresh = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] use_chap_auth = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] use_default_quota_class = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] use_journal = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] use_json = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] use_multipath_for_image_xfer = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] use_stderr = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] use_syslog = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] verify_glance_signatures = enabled {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_api_class = cinder.volume.api.API {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_backend_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_clear = zero {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_clear_ionice = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_clear_size = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_copy_bps_limit = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_dd_blocksize = 1M {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_name_template = volume-%s {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_service_inithost_offload = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volume_usage_audit_period = month {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] zoning_mode = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_concurrency.disable_process_locking = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.auth_section = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.auth_type = password {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.auth_version = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.cache = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.certfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.include_service_catalog = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.insecure = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.interface = public {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.keyfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_password = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcache_username = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.region_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.service_type = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.backend = dogpile.cache.null {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.backend_argument = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.backend_expiration_time = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.config_prefix = cache.oslo {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.debug_cache_backend = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.enable_retry_client = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.enable_socket_keepalive = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.enabled = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.expiration_time = 600 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.hashclient_retry_attempts = 2 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.memcache_dead_retry = 300 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.memcache_pool_maxsize = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.memcache_sasl_enabled = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.password = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.proxies = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.redis_db = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.redis_server = localhost:6379 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.retry_attempts = 2 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.retry_delay = 0.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.socket_keepalive_count = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.socket_keepalive_idle = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.socket_keepalive_interval = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.socket_timeout = 1.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.tls_allowed_ciphers = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.tls_cafile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.tls_certfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.tls_enabled = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.tls_keyfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cache.username = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] coordination.backend_url = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.asyncio_connection = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.asyncio_slave_connection = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.backend = sqlalchemy {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.connection = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.connection_debug = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.connection_parameters = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.connection_recycle_time = 3600 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.connection_trace = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.db_inc_retry_interval = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.db_max_retries = 20 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.db_max_retry_interval = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.db_retry_interval = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.max_overflow = 50 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.max_pool_size = 5 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.max_retries = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.mysql_wsrep_sync_wait = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.pool_timeout = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.retry_interval = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.slave_connection = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.sqlite_synchronous = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.synchronous_reader = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] database.use_db_reconnect = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.connection_string = messaging:// {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.enabled = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.es_doc_type = notification {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.es_scroll_size = 10000 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.es_scroll_time = 2m {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.filter_error_trace = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87179) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 08:11:25 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.quobyte [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.hmac_keys = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.sentinel_service_name = mymaster {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.socket_timeout = 0.1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.trace_requests = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.quobyte [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler.trace_sqlalchemy = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler_jaeger.process_tags = {} {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler_jaeger.service_name_prefix = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] profiler_otlp.service_name_prefix = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.enforce_new_defaults = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Running cmd (subprocess): mount.quobyte {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.enforce_scope = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.policy_default_rule = default {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.policy_file = policy.yaml {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] privsep_osbrick.group = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] privsep_osbrick.helper_command = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] privsep_osbrick.user = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cinder_sys_admin.group = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cinder_sys_admin.helper_command = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] cinder_sys_admin.user = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.auth_section = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.auth_type = password {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.cafile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.certfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.collect_timing = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.insecure = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.keyfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.send_service_user_token = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.split_loggers = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] service_user.timeout = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.auth_section = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.auth_type = password {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.certfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.collect_timing = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.insecure = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.keyfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.region_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.split_loggers = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] glance.timeout = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.backend_availability_zone = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.chap_password = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.chap_username = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.disk_geometry = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.driver_client_cert = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.driver_client_cert_key = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.driver_data_namespace = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.driver_use_ssl = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.extra_capabilities = {} {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.filter_function = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.goodness_function = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.iscsi_target_flags = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.iscsi_write_cache = on {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.iser_helper = tgtadm {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.iser_port = 3260 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_host = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_login = admin {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_mount_options = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_password = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_private_key = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_share_path = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.num_shell_tries = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.quobyte_volume_url = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.replication_device = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.report_discard_supported = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.reserved_percentage = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.target_helper = tgtadm {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.target_port = 3260 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.target_protocol = iscsi {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.trace_flags = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.unique_fqdn_network = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.use_chap_auth = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.volume_backend_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.volume_clear = zero {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.volume_clear_ionice = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.volume_clear_size = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_reports.file_event_handler = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_reports.log_dir = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.backend_availability_zone = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.backend_host = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.chap_password = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.chap_username = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.chiscsi_conf = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.disk_geometry = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.driver_client_cert = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.driver_data_namespace = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.driver_use_ssl = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.extra_capabilities = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.filter_function = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.goodness_function = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.iser_helper = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.iser_ip_address = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.iser_port = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.iser_target_prefix = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_host = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_login = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_mount_options = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_password = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_private_key = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_share_path = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_ssh_port = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.num_shell_tries = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack quobyte-client[87180]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.nvmet_port_id = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack quobyte-client[87180]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.replication_device = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.report_discard_supported = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.reserved_percentage = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.scst_target_driver = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.storage_protocol = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.target_helper = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.target_ip_address = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.target_port = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.target_prefix = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.target_protocol = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.trace_flags = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.use_chap_auth = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.volume_clear = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.volume_clear_size = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] QuobyteHD.volumes_dir = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.ssl = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_notifications.driver = [] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_notifications.retry = -1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] key_manager.fixed_key = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.barbican_api_version = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.barbican_endpoint = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.barbican_endpoint_type = public {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.barbican_region_name = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.cafile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.certfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.collect_timing = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.insecure = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.keyfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.number_of_retries = 60 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.retry_delay = 1 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.send_service_user_token = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.split_loggers = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.timeout = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.verify_ssl = True {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican.verify_ssl_path = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican_service_user.auth_section = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican_service_user.auth_type = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican_service_user.cafile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican_service_user.certfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican_service_user.collect_timing = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican_service_user.insecure = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican_service_user.keyfile = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican_service_user.split_loggers = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] barbican_service_user.timeout = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.approle_role_id = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.approle_secret_id = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.kv_mountpoint = secret {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.kv_path = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.kv_version = 2 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.namespace = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.root_token_id = **** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.ssl_ca_crt_file = None {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.timeout = 60.0 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.use_ssl = False {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 08:11:25 devstack cinder-volume[86918]: DEBUG oslo_service.backend._eventlet.service [None req-81258cf2-9d5c-40d6-9762-fb3129bfb259 None None] ******************************************************************************** {{(pid=86918) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 08:11:25 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:11:25 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:26 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.624s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:26 devstack cinder-volume[87179]: INFO cinder.volume.driver [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.volume.driver [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87179) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_db.sqlalchemy.engines [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writer thread running {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.db.api [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Building query based on filter {{(pid=87179) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87179) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:26 devstack cinder-volume[87179]: INFO cinder.keymgr.migration [None req-00a2d114-ee48-492e-b81b-2153cbcde9d7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 08:11:26 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:11:26 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:26 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.649s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:11:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Driver initialization completed successfully. Jul 07 08:11:26 devstack cinder-volume[87179]: INFO cinder.manager [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Initiating service 3 cleanup Jul 07 08:11:26 devstack cinder-volume[87179]: INFO cinder.manager [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Service 3 cleanup completed. Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.service [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Creating RPC server for service cinder-volume {{(pid=87179) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.service [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87179) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 08:11:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:11:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:11:26 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:11:26 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:11:27 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Jul 07 08:11:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.606s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:11:27 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ba42f62a-af0f-4881-9446-3ec28cf84346 None None] Driver post RPC initialization completed successfully. Jul 07 08:11:35 devstack cinder-volume[86918]: DEBUG dbcounter [-] [86918] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86918) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:11:36 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=2 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:11:37 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:12:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:12:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 6 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:12:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Flow 'volume_create_manager' (4f057891-66f3-42a4-9094-22e9a33f6346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736f6de3-bc83-4885-af98-31b866346dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736f6de3-bc83-4885-af98-31b866346dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-371337217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d855ffbf-8f78-4bf9-a553-b2fa598d29ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc3a5d8725940c4be6e39fd19633d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:26Z,use_quota=True,user_id='e31f71764cbc4d40928534bbf6a9599a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28785c8d-dc07-4e7a-8fff-fba365f1f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28785c8d-dc07-4e7a-8fff-fba365f1f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb04f25-3919-454c-a52a-214977047983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb04f25-3919-454c-a52a-214977047983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd855ffbf-8f78-4bf9-a553-b2fa598d29ab', 'volume_name': 'volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd4668d-d2d6-429d-888c-e4361447caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd4668d-d2d6-429d-888c-e4361447caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35b1508-629c-4d41-9523-c3ac390ad527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Volume d855ffbf-8f78-4bf9-a553-b2fa598d29ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab', 'volume_size': 1} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-371337217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d855ffbf-8f78-4bf9-a553-b2fa598d29ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc3a5d8725940c4be6e39fd19633d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:26Z,use_quota=True,user_id='e31f71764cbc4d40928534bbf6a9599a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Creating volume d855ffbf-8f78-4bf9-a553-b2fa598d29ab {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:12:26 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:26 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab 1073741824 Jul 07 08:12:26 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Flow 'volume_create_manager' (bfb928cb-9515-42bf-a809-8554f30efd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92739a03-dcf3-430c-97c4-cb8111579b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92739a03-dcf3-430c-97c4-cb8111579b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1996125038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c895e7a2-6952-4d03-b043-2ea9f2a0d4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9039d57b6eba4dd785d977844f1c839a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:26Z,use_quota=True,user_id='b67ff273555e4566a95cc1f570352b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf198797-da0f-46ac-a431-f3ca8efbc87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf198797-da0f-46ac-a431-f3ca8efbc87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb30a79-9047-46b4-a5ba-6a25d38aace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb30a79-9047-46b4-a5ba-6a25d38aace2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c895e7a2-6952-4d03-b043-2ea9f2a0d4bc', 'volume_name': 'volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d137fa5-d81e-4ddd-b8e6-49f87bdf3b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d137fa5-d81e-4ddd-b8e6-49f87bdf3b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64201143-f791-4241-93e2-e0f6065926ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:26 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Volume c895e7a2-6952-4d03-b043-2ea9f2a0d4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc', 'volume_size': 1} Jul 07 08:12:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:27 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab 1073741824" returned: 0 in 1.476s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:28 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab Jul 07 08:12:28 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:29 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" returned: 0 in 1.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] <== create_volume: return (3330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.332s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.978s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1996125038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c895e7a2-6952-4d03-b043-2ea9f2a0d4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9039d57b6eba4dd785d977844f1c839a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:26Z,use_quota=True,user_id='b67ff273555e4566a95cc1f570352b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Creating volume c895e7a2-6952-4d03-b043-2ea9f2a0d4bc {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:12:29 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35b1508-629c-4d41-9523-c3ac390ad527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:29 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc 1073741824 Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47492ff8-f63f-4ccf-a519-ad6307503ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:29 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:29 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Volume volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab (d855ffbf-8f78-4bf9-a553-b2fa598d29ab): created successfully Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47492ff8-f63f-4ccf-a519-ad6307503ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Flow 'volume_create_manager' (4f057891-66f3-42a4-9094-22e9a33f6346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-9cf35f22-2828-4eba-b6e0-5efb1a53b428 req-851b345a-ec11-4d0a-afa0-266b6317ddb6 tempest-VolumesSnapshotsTestJSON-1032666333 None] Created volume successfully. Jul 07 08:12:31 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc 1073741824" returned: 0 in 2.024s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:31 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc Jul 07 08:12:31 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:33 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc" returned: 0 in 1.414s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] <== create_volume: return (3606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:12:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.615s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.482s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Creating offline snapshot 3b228aba-1b80-4615-a8a8-5eb132f00961 of volume d855ffbf-8f78-4bf9-a553-b2fa598d29ab {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:12:33 devstack cinder-volume[87179]: INFO oslo.privsep.daemon [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpft6vq6wm/privsep.sock'] Jul 07 08:12:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64201143-f791-4241-93e2-e0f6065926ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee1c088-e82c-42c8-b621-b8d94d5dbe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:33 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpft6vq6wm/privsep.sock Jul 07 08:12:33 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Volume volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc (c895e7a2-6952-4d03-b043-2ea9f2a0d4bc): created successfully Jul 07 08:12:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee1c088-e82c-42c8-b621-b8d94d5dbe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Flow 'volume_create_manager' (bfb928cb-9515-42bf-a809-8554f30efd8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-626deb29-52da-4946-9e0c-c27ce9411648 tempest-DeleteServersTestJSON-695053335 None] Created volume successfully. Jul 07 08:12:34 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 08:12:34 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:12:34 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 08:12:34 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 08:12:34 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:12:34 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 08:12:34 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:12:34 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 08:12:34 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 08:12:35 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 08:12:35 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 08:12:35 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 08:12:35 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 08:12:35 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 08:12:35 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 08:12:35 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 08:12:35 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 08:12:35 devstack cinder-volume[87179]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 08:12:35 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:35 devstack cinder-volume[87179]: INFO oslo.privsep.daemon [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Spawned new privsep daemon via rootwrap Jul 07 08:12:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Accepted privsep connection to /tmp/tmpft6vq6wm/privsep.sock {{(pid=87179) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 08:12:35 devstack cinder-volume[87179]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 08:12:35 devstack cinder-volume[87179]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 08:12:35 devstack cinder-volume[87179]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 08:12:35 devstack cinder-volume[87179]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88107 Jul 07 08:12:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6587079-b16c-4e5e-b322-ca9ea264e46f]: (2,) {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:12:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19f3ddc-4a11-4fbd-914a-563ac068a975]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:12:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:35 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab Jul 07 08:12:35 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:36 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" returned: 0 in 1.009s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:36 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 1G Jul 07 08:12:36 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:37 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 1G" returned: 0 in 1.149s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:37 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 Jul 07 08:12:37 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:38 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961" returned: 0 in 0.855s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:38 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 is being set with open permissions: ugo+rw Jul 07 08:12:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:38 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 Jul 07 08:12:38 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:39 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961" returned: 0 in 0.910s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:39 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.info Jul 07 08:12:39 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:40 devstack cinder-volume[87179]: WARNING py.warnings [req-25d8bd48-4261-419c-a2ff-b8d3d70e84fe req-63729f50-52b5-4df8-a563-6da26fe7a6f8 tempest-DeleteServersTestJSON-695053335 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 07 08:12:40 devstack cinder-volume[87179]: .first() Jul 07 08:12:40 devstack cinder-volume[87179]: Jul 07 08:12:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-25d8bd48-4261-419c-a2ff-b8d3d70e84fe req-63729f50-52b5-4df8-a563-6da26fe7a6f8 tempest-DeleteServersTestJSON-695053335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:40 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.info" returned: 0 in 1.343s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:40 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.info is being set with open permissions: ugo+rw Jul 07 08:12:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:40 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.info Jul 07 08:12:40 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:42 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.info" returned: 0 in 1.314s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.971s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-25d8bd48-4261-419c-a2ff-b8d3d70e84fe req-63729f50-52b5-4df8-a563-6da26fe7a6f8 tempest-DeleteServersTestJSON-695053335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.384s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:42 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a80b47-773d-49a5-b72a-34593b771f78]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:12:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-25d8bd48-4261-419c-a2ff-b8d3d70e84fe req-63729f50-52b5-4df8-a563-6da26fe7a6f8 tempest-DeleteServersTestJSON-695053335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:42 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-9104d66e-7715-4c21-bf7e-b8e7f0900d48 req-6b7b3b96-7b1e-4cb0-9061-6cb39748ff55 tempest-VolumesSnapshotsTestJSON-1032666333 None] Create snapshot completed successfully Jul 07 08:12:42 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc Jul 07 08:12:42 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Acquiring lock "cinder-3b228aba-1b80-4615-a8a8-5eb132f00961-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-3b228aba-1b80-4615-a8a8-5eb132f00961-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Acquiring lock "cinder-quobyte-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-quobyte-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Acquiring lock "cinder-quobyte-3b228aba-1b80-4615-a8a8-5eb132f00961" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-quobyte-3b228aba-1b80-4615-a8a8-5eb132f00961" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Deleting offline snapshot 3b228aba-1b80-4615-a8a8-5eb132f00961 of volume d855ffbf-8f78-4bf9-a553-b2fa598d29ab {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] snapshot_file for this snap is: volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df101d-a5cc-4246-8881-878c7e8cfac4]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:43 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-25d8bd48-4261-419c-a2ff-b8d3d70e84fe req-63729f50-52b5-4df8-a563-6da26fe7a6f8 tempest-DeleteServersTestJSON-695053335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc" returned: 0 in 1.671s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-25d8bd48-4261-419c-a2ff-b8d3d70e84fe req-63729f50-52b5-4df8-a563-6da26fe7a6f8 tempest-DeleteServersTestJSON-695053335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.788s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-25d8bd48-4261-419c-a2ff-b8d3d70e84fe req-63729f50-52b5-4df8-a563-6da26fe7a6f8 tempest-DeleteServersTestJSON-695053335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c7abf8c-3a6b-401b-91b1-18d7d238eeb9', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:12:44 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 Jul 07 08:12:44 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:44 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-25d8bd48-4261-419c-a2ff-b8d3d70e84fe req-63729f50-52b5-4df8-a563-6da26fe7a6f8 tempest-DeleteServersTestJSON-695053335 None] attachment_update completed successfully. Jul 07 08:12:45 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961" returned: 0 in 1.279s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:12:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[7873c98b-76e7-422c-b5c6-6a00d45e083b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:12:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:45 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab Jul 07 08:12:45 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:46 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" returned: 0 in 1.039s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:46 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 Jul 07 08:12:46 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:47 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961" returned: 0 in 0.924s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:47 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961 Jul 07 08:12:47 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:47 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab.3b228aba-1b80-4615-a8a8-5eb132f00961" returned: 0 in 0.689s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-quobyte-3b228aba-1b80-4615-a8a8-5eb132f00961" released by "_delete_snapshot" :: held 4.179s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:12:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-quobyte-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" released by "delete_snapshot" :: held 4.250s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:12:48 devstack cinder-volume[87179]: WARNING cinder.quota [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:12:48 devstack cinder-volume[87179]: WARNING cinder.quota [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:12:48 devstack cinder-volume[87179]: DEBUG cinder.quota [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Created reservations ['992e2ef8-4d59-4dd1-992f-3af948dc4e23', 'e4c7d340-102a-4f50-9ace-913f9c52760d', '2f53695b-8c8b-4afb-8b98-8e1569125902', '8ab1630b-0c34-42d3-b22a-241244e04afe'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:12:48 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Delete snapshot completed successfully. Jul 07 08:12:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-1cb2c6d6-d32e-4da6-9cc5-b0a33aab4974 req-9edd5d20-95d0-4ee7-8883-3093a105f579 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-3b228aba-1b80-4615-a8a8-5eb132f00961-delete_snapshot" released by "delete_snapshot" :: held 4.521s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:12:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Acquiring lock "cinder-d855ffbf-8f78-4bf9-a553-b2fa598d29ab-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:12:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-d855ffbf-8f78-4bf9-a553-b2fa598d29ab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:12:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Acquiring lock "cinder-quobyte-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:12:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-quobyte-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:12:48 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec30e50-05cf-4b83-850a-057b73e93206]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:12:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:48 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab Jul 07 08:12:48 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:49 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" returned: 0 in 0.834s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:49 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab Jul 07 08:12:49 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:50 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" returned: 0 in 0.862s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-quobyte-d855ffbf-8f78-4bf9-a553-b2fa598d29ab" released by "delete_volume" :: held 1.784s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:12:50 devstack cinder-volume[87179]: WARNING cinder.quota [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:12:50 devstack cinder-volume[87179]: DEBUG cinder.quota [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Created reservations ['4bbeaf9d-01e0-4961-b5fa-87918057cbbe', '1bd68584-2113-4d98-814e-0606fbdca58b', '916b1b2c-bda2-4d93-bb03-6542372606a5', '650ed1a9-d6d9-4fec-8aa2-0c6a9b5ca7e6'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:12:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:12:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:12:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:50 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:12:50 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:51 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.994s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.manager [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:12:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Deleted volume successfully. Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-771fc7bc-2bcb-4eb3-8028-9eed42c73e08 req-95e05a1f-91cc-4e82-ab21-1efb461e5305 tempest-VolumesSnapshotsTestJSON-1032666333 None] Lock "cinder-d855ffbf-8f78-4bf9-a553-b2fa598d29ab-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Flow 'volume_create_manager' (51c002ac-d4c6-454d-9761-007b7262be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d505e6-998e-45af-8953-832b88f4298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d505e6-998e-45af-8953-832b88f4298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1431313031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8280a8df-80cb-414b-9aab-c1882b5bed87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5480d90f3b44dfb03f09ebdab38ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:52Z,use_quota=True,user_id='a33d072895b44fc7806c5e3ab01dda0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51323649-5532-47e7-a118-7f63554cfc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51323649-5532-47e7-a118-7f63554cfc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dec36e2-419a-440e-8074-adffb41a52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dec36e2-419a-440e-8074-adffb41a52cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8280a8df-80cb-414b-9aab-c1882b5bed87', 'volume_name': 'volume-8280a8df-80cb-414b-9aab-c1882b5bed87', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b26668f-459f-4b03-a77f-df31798be916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b26668f-459f-4b03-a77f-df31798be916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2813b91-8435-437f-8f24-95c2f145435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:51 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Volume 8280a8df-80cb-414b-9aab-c1882b5bed87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8280a8df-80cb-414b-9aab-c1882b5bed87', 'volume_size': 1} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1431313031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8280a8df-80cb-414b-9aab-c1882b5bed87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5480d90f3b44dfb03f09ebdab38ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:52Z,use_quota=True,user_id='a33d072895b44fc7806c5e3ab01dda0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Creating volume 8280a8df-80cb-414b-9aab-c1882b5bed87 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:12:51 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:12:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:51 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87 1073741824 Jul 07 08:12:51 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:53 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87 1073741824" returned: 0 in 1.252s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:53 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87 Jul 07 08:12:53 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:53 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87" returned: 0 in 0.723s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:12:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2813b91-8435-437f-8f24-95c2f145435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8280a8df-80cb-414b-9aab-c1882b5bed87', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a982acc2-2d94-4c03-a4cf-ce7a57bd3b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:54 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Volume volume-8280a8df-80cb-414b-9aab-c1882b5bed87 (8280a8df-80cb-414b-9aab-c1882b5bed87): created successfully Jul 07 08:12:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a982acc2-2d94-4c03-a4cf-ce7a57bd3b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Flow 'volume_create_manager' (51c002ac-d4c6-454d-9761-007b7262be1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:54 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d2df03b2-a406-43d5-a0b6-0f18a40a9b50 tempest-ServersNegativeTestJSON-1384176343 None] Created volume successfully. Jul 07 08:12:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-d30f12ee-99cd-4e30-bde5-1d5a08e30a51 req-40337013-4a92-4359-b878-33b58767d956 tempest-DeleteServersTestJSON-695053335 None] Terminate volume connection completed successfully. Jul 07 08:12:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-d30f12ee-99cd-4e30-bde5-1d5a08e30a51 req-40337013-4a92-4359-b878-33b58767d956 tempest-DeleteServersTestJSON-695053335 None] Deleting attachment 9c7abf8c-3a6b-401b-91b1-18d7d238eeb9. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Flow 'volume_create_manager' (e2a6ffa1-0b80-4a89-b995-83b80d16edf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2134fb-382a-496d-b03b-6e752a864fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2134fb-382a-496d-b03b-6e752a864fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1591699559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feba93b7-3ece-46f9-b88f-c4142d92f35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5480d90f3b44dfb03f09ebdab38ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:58Z,use_quota=True,user_id='a33d072895b44fc7806c5e3ab01dda0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7569576-eb20-4cd4-b8e8-7fb65cbf7f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7569576-eb20-4cd4-b8e8-7fb65cbf7f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca66da0-0d1e-4878-9833-b6f3127283af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca66da0-0d1e-4878-9833-b6f3127283af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feba93b7-3ece-46f9-b88f-c4142d92f35b', 'volume_name': 'volume-feba93b7-3ece-46f9-b88f-c4142d92f35b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e8daa4-ffdf-421c-9a81-680c92556ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e8daa4-ffdf-421c-9a81-680c92556ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3335506f-df52-4a49-a05d-544889da1375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:57 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Volume feba93b7-3ece-46f9-b88f-c4142d92f35b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feba93b7-3ece-46f9-b88f-c4142d92f35b', 'volume_size': 1} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1591699559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feba93b7-3ece-46f9-b88f-c4142d92f35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5480d90f3b44dfb03f09ebdab38ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:12:58Z,use_quota=True,user_id='a33d072895b44fc7806c5e3ab01dda0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Creating volume feba93b7-3ece-46f9-b88f-c4142d92f35b {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:12:57 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:12:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:57 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b 1073741824 Jul 07 08:12:57 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:58 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b 1073741824" returned: 0 in 0.935s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:12:58 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b Jul 07 08:12:58 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:12:59 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Jul 07 08:12:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b" returned: 0 in 0.682s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:12:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:12:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:12:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3335506f-df52-4a49-a05d-544889da1375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feba93b7-3ece-46f9-b88f-c4142d92f35b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee28f66-9a3d-4a94-9fce-c5426ca8758b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:12:59 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Volume volume-feba93b7-3ece-46f9-b88f-c4142d92f35b (feba93b7-3ece-46f9-b88f-c4142d92f35b): created successfully Jul 07 08:12:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee28f66-9a3d-4a94-9fce-c5426ca8758b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:12:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Flow 'volume_create_manager' (e2a6ffa1-0b80-4a89-b995-83b80d16edf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:12:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8b99a512-3acd-4762-a0d7-b4c2fb894e96 tempest-ServersNegativeTestJSON-1384176343 None] Created volume successfully. Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Acquiring lock "cinder-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Lock "cinder-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Acquiring lock "cinder-quobyte-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Lock "cinder-quobyte-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc" acquired by "delete_volume" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6072ed-95b9-443b-a811-f8cd658f751b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:00 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc Jul 07 08:13:00 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "cinder-feba93b7-3ece-46f9-b88f-c4142d92f35b-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Lock "cinder-feba93b7-3ece-46f9-b88f-c4142d92f35b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "cinder-quobyte-feba93b7-3ece-46f9-b88f-c4142d92f35b" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Lock "cinder-quobyte-feba93b7-3ece-46f9-b88f-c4142d92f35b" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a401fda7-793b-406a-8ada-9ed5e538c6ab]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:01 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b Jul 07 08:13:01 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:01 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc" returned: 0 in 1.036s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:01 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc Jul 07 08:13:01 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:02 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b" returned: 0 in 1.154s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:02 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b Jul 07 08:13:02 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:02 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc" returned: 0 in 1.005s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Lock "cinder-quobyte-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc" released by "delete_volume" :: held 2.113s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Created reservations ['67142a0f-cca6-457c-8eb6-9a6de22ee99c', '3d5b74f3-c686-4481-a215-a387d60c5183', 'd31f7d37-07c7-48d4-a120-3734592f0c83', '459805e1-3ab6-4b44-b932-405adedc0de2'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:02 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:13:02 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:03 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-feba93b7-3ece-46f9-b88f-c4142d92f35b" returned: 0 in 0.992s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Lock "cinder-quobyte-feba93b7-3ece-46f9-b88f-c4142d92f35b" released by "delete_volume" :: held 2.193s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Created reservations ['06fd4dac-3bdf-4f5e-ad28-e14a41b62808', '51b36a68-7d97-4fbd-9a8d-60a661cb6f9e', 'f60dd223-f5cb-4c97-9870-38d42c9c19de', '07ad8a1a-3afd-49c2-96c2-e4aab7a2a58f'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:03 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:13:03 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:03 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.868s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:13:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Deleted volume successfully. Jul 07 08:13:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-53ca8c13-6a39-427b-8c4f-484c335273ac tempest-DeleteServersTestJSON-695053335 None] Lock "cinder-c895e7a2-6952-4d03-b043-2ea9f2a0d4bc-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5de48d48-0251-4d69-9805-6ace07b0d37d tempest-GroupsV314Test-842799278 None] Group tempest-GroupsV314Test-Group-687682666: creating Jul 07 08:13:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5de48d48-0251-4d69-9805-6ace07b0d37d tempest-GroupsV314Test-842799278 None] Group tempest-GroupsV314Test-Group-687682666: created successfully Jul 07 08:13:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5de48d48-0251-4d69-9805-6ace07b0d37d tempest-GroupsV314Test-842799278 None] Create group completed successfully. Jul 07 08:13:04 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.856s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:13:04 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Deleted volume successfully. Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "cinder-8280a8df-80cb-414b-9aab-c1882b5bed87-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Lock "cinder-8280a8df-80cb-414b-9aab-c1882b5bed87-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-68bfe6fb-397a-404c-aeb1-deca1b68de81 tempest-ServersNegativeTestJSON-1384176343 None] Lock "cinder-feba93b7-3ece-46f9-b88f-c4142d92f35b-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "cinder-quobyte-8280a8df-80cb-414b-9aab-c1882b5bed87" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Lock "cinder-quobyte-8280a8df-80cb-414b-9aab-c1882b5bed87" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddc6009-861d-4c83-a01c-01d6295f3800]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:04 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87 Jul 07 08:13:04 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:04 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:13:04 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:05 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87" returned: 0 in 0.886s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:05 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87 Jul 07 08:13:05 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:05 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.073s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 8 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Flow 'volume_create_manager' (aac6186f-652f-48e3-b8eb-1a733cfdfac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef641942-61c2-460a-8f18-219b76869f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef641942-61c2-460a-8f18-219b76869f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1633062437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25268291-31c4-414d-9313-9df11718a12e,host='devstack@QuobyteHD#QuobyteHD',id=1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0fa40d143842aaa799a516e3700d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:06Z,use_quota=True,user_id='d34e26721fc34aef869712342e120ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dac22af-afcb-4b7c-8998-ff9a24e0f2f9),volume_type_id=4dac22af-afcb-4b7c-8998-ff9a24e0f2f9)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2920c753-65ef-4799-b029-410243c66d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2920c753-65ef-4799-b029-410243c66d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a13998f-8b04-4a9c-af6b-628a3cf9e6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a13998f-8b04-4a9c-af6b-628a3cf9e6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce', 'volume_name': 'volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6debe43c-fcbd-4e9d-8fe1-2ec5df74de17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6debe43c-fcbd-4e9d-8fe1-2ec5df74de17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b34bc8-1c5e-4a64-a058-66f5403b1380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:05 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Volume 1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce', 'volume_size': 1} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25268291-31c4-414d-9313-9df11718a12e,created_at=2026-07-07T06:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1633062437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25268291-31c4-414d-9313-9df11718a12e,host='devstack@QuobyteHD#QuobyteHD',id=1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0fa40d143842aaa799a516e3700d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:06Z,use_quota=True,user_id='d34e26721fc34aef869712342e120ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dac22af-afcb-4b7c-8998-ff9a24e0f2f9),volume_type_id=4dac22af-afcb-4b7c-8998-ff9a24e0f2f9)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Creating volume 1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:13:05 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:13:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:06 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce 1073741824 Jul 07 08:13:06 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:06 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8280a8df-80cb-414b-9aab-c1882b5bed87" returned: 0 in 1.031s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Lock "cinder-quobyte-8280a8df-80cb-414b-9aab-c1882b5bed87" released by "delete_volume" :: held 1.968s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:06 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Created reservations ['c5cd4dcf-da71-40ff-8071-722456403c17', '4da73454-8c1d-4921-b0f4-08b00359c381', '31d6ed42-6099-4e1f-aea8-5efab2f56537', '95083818-fd42-416e-95c9-b2f38a502c83'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:06 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:13:06 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:07 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.017s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:07 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:13:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Deleted volume successfully. Jul 07 08:13:07 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce 1073741824" returned: 0 in 1.574s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-491e1c6a-0a8a-4266-951b-180bd87da251 tempest-ServersNegativeTestJSON-1384176343 None] Lock "cinder-8280a8df-80cb-414b-9aab-c1882b5bed87-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:07 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce Jul 07 08:13:07 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:08 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" returned: 0 in 0.751s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] <== create_volume: return (2382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:13:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b34bc8-1c5e-4a64-a058-66f5403b1380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c12c04-8c10-4bb1-ae0d-6b41f1df1192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:08 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Volume volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce (1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce): created successfully Jul 07 08:13:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c12c04-8c10-4bb1-ae0d-6b41f1df1192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Flow 'volume_create_manager' (aac6186f-652f-48e3-b8eb-1a733cfdfac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c7bf12b3-d587-47ff-8dbf-5e0c1d46d933 tempest-GroupsV314Test-842799278 None] Created volume successfully. Jul 07 08:13:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:09 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Cloning volume 1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce to volume 51beed21-11bc-46bb-9051-5669203bbe45 Jul 07 08:13:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Creating offline snapshot 494e30ac-8fc6-4c19-9254-92213a8f4b2d of volume 1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:13:10 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[25900451-6253-4be7-af0e-f2d73a6e9456]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:10 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce Jul 07 08:13:10 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:11 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" returned: 0 in 0.940s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:11 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d 1G Jul 07 08:13:11 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:12 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d 1G" returned: 0 in 1.257s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:12 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d Jul 07 08:13:12 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:13 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d" returned: 0 in 0.842s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:13 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:13:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:13 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d Jul 07 08:13:13 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:13 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d" returned: 0 in 0.743s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:13 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.info Jul 07 08:13:13 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:14 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.info" returned: 0 in 0.760s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:14 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:13:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:14 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.info Jul 07 08:13:14 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:15 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.info" returned: 0 in 0.694s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Acquiring lock "cinder-quobyte-51beed21-11bc-46bb-9051-5669203bbe45" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Lock "cinder-quobyte-51beed21-11bc-46bb-9051-5669203bbe45" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] snapshot: 494e30ac-8fc6-4c19-9254-92213a8f4b2d, volume: 51beed21-11bc-46bb-9051-5669203bbe45, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[797e24b1-447e-4d50-9a61-7cb5bf36c095]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:15 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d Jul 07 08:13:15 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:16 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d" returned: 0 in 0.866s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:16 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:13:16 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:13:16 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:13:16 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c50ae07-ad02-4b17-873e-9ff4622e1c55]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:16 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce Jul 07 08:13:16 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:17 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" returned: 0 in 0.866s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:17 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:13:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:17 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 Jul 07 08:13:17 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:23 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45" returned: 0 in 6.226s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d40cc2c-eec6-433e-9c1a-2144a9d67c28]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:23 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce Jul 07 08:13:23 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:23 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=50,cinder:INSERT=10,cinder:UPDATE=56,cinder:DELETE=8 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:13:23 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=58,cinder:SELECT=55,cinder:INSERT=18,cinder:DELETE=2 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:13:24 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" returned: 0 in 1.028s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:24 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:13:24 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Converted 1024.00 MB image at 164.44 MB/s Jul 07 08:13:24 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:13:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:24 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 Jul 07 08:13:24 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:25 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45" returned: 0 in 0.720s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Lock "cinder-quobyte-51beed21-11bc-46bb-9051-5669203bbe45" released by "_copy_volume_from_snapshot" :: held 9.841s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Acquiring lock "cinder-quobyte-494e30ac-8fc6-4c19-9254-92213a8f4b2d" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Lock "cinder-quobyte-494e30ac-8fc6-4c19-9254-92213a8f4b2d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Deleting offline snapshot 494e30ac-8fc6-4c19-9254-92213a8f4b2d of volume 1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:13:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] snapshot_file for this snap is: volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:13:25 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e825e968-580d-4ec6-872c-2f52f9e9a3ed]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:25 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d Jul 07 08:13:25 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:26 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d" returned: 0 in 0.873s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:13:26 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aba928-6118-440c-9bf3-213c6f92c4c7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:26 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce Jul 07 08:13:26 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:27 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" returned: 0 in 0.913s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:27 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d Jul 07 08:13:27 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:28 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d" returned: 0 in 0.856s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:28 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d Jul 07 08:13:28 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:28 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce.494e30ac-8fc6-4c19-9254-92213a8f4b2d" returned: 0 in 0.765s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:28 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Lock "cinder-quobyte-494e30ac-8fc6-4c19-9254-92213a8f4b2d" released by "_delete_snapshot" :: held 3.535s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.930s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:28 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c7f17806-dfd2-4e89-8f93-215eaa40a309 tempest-GroupsV314Test-842799278 None] Create group from source-group-25268291-31c4-414d-9313-9df11718a12e completed successfully. Jul 07 08:13:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Acquiring lock "cinder-quobyte-51beed21-11bc-46bb-9051-5669203bbe45" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Lock "cinder-quobyte-51beed21-11bc-46bb-9051-5669203bbe45" acquired by "delete_volume" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:30 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f85be-79f2-4f84-9113-ecdb661ed0f5]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:30 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 Jul 07 08:13:30 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:31 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45" returned: 0 in 1.020s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:31 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45 Jul 07 08:13:31 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:32 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-51beed21-11bc-46bb-9051-5669203bbe45" returned: 0 in 0.791s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Lock "cinder-quobyte-51beed21-11bc-46bb-9051-5669203bbe45" released by "delete_volume" :: held 1.889s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Created reservations ['6d9cc123-792c-4895-8aff-481359c1c9ce'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:32 devstack cinder-volume[87179]: WARNING cinder.quota [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1388652762 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1388652762, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:13:32 devstack cinder-volume[87179]: WARNING cinder.quota [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1388652762 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1388652762, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Created reservations ['ed68c25f-80b1-4d84-9451-a285c71eabda', '030a741d-10cf-4fd5-a89c-e5a6d98402f3', '216622fa-9965-4494-9909-f43784bd5933', '97550300-3937-44c3-8024-ed6bf3fbb2a5'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:32 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:13:32 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Acquiring lock "cinder-quobyte-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Flow 'volume_create_manager' (f905fb1c-01cc-4971-9cf4-f0fd40e92f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c529ebf8-f202-41bb-8144-123c9c9d0351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c529ebf8-f202-41bb-8144-123c9c9d0351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-47012183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453ba29d-f60d-4269-9702-fbd2fa44aa54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1269248d6e4b4252aca64522733d9732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:33Z,use_quota=True,user_id='e9f630b596d24d4b80d4dd79d11f9b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c3305a-0975-4196-874b-2335e74bea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c3305a-0975-4196-874b-2335e74bea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7be020-ead0-4766-8b71-4a4fccda1b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7be020-ead0-4766-8b71-4a4fccda1b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453ba29d-f60d-4269-9702-fbd2fa44aa54', 'volume_name': 'volume-453ba29d-f60d-4269-9702-fbd2fa44aa54', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3fcd17-7148-4bdb-b911-0a7282aba2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3fcd17-7148-4bdb-b911-0a7282aba2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6114a0d9-3af6-4748-9e7e-fe09c0417048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Volume 453ba29d-f60d-4269-9702-fbd2fa44aa54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453ba29d-f60d-4269-9702-fbd2fa44aa54', 'volume_size': 1} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-47012183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453ba29d-f60d-4269-9702-fbd2fa44aa54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1269248d6e4b4252aca64522733d9732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:33Z,use_quota=True,user_id='e9f630b596d24d4b80d4dd79d11f9b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Creating volume 453ba29d-f60d-4269-9702-fbd2fa44aa54 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:13:33 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Lock "cinder-quobyte-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" acquired by "delete_volume" :: waited 0.174s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:33 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 1073741824 Jul 07 08:13:33 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e096a9-663f-42b3-9228-8f0a70fbcde6]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:33 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.039s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:33 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:13:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-fe3b68cd-07b6-4544-a0c1-b2803d316330 tempest-GroupsV314Test-842799278 None] Delete group completed successfully. Jul 07 08:13:33 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce Jul 07 08:13:33 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:34 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" returned: 0 in 0.842s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:34 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 1073741824" returned: 0 in 0.921s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:34 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce Jul 07 08:13:34 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:34 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 Jul 07 08:13:34 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:35 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" returned: 0 in 0.852s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Lock "cinder-quobyte-1c6f4585-a17f-43c7-abd0-2c4bf1ab01ce" released by "delete_volume" :: held 1.773s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:35 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54" returned: 0 in 0.831s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6114a0d9-3af6-4748-9e7e-fe09c0417048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453ba29d-f60d-4269-9702-fbd2fa44aa54', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a60f668-c8a6-4d98-8107-f918df0140d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Volume volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 (453ba29d-f60d-4269-9702-fbd2fa44aa54): created successfully Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a60f668-c8a6-4d98-8107-f918df0140d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Flow 'volume_create_manager' (f905fb1c-01cc-4971-9cf4-f0fd40e92f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:35 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-03a6cb0a-80cb-4867-9680-758da7e12d0d req-1df5f801-24cc-4eca-9b2b-a6da0b2c82f9 tempest-VolumesGetTestJSON-1793191547 None] Created volume successfully. Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Created reservations ['6bcfd256-7ff9-4447-994e-7d50d72df036'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Created reservations ['cb991aae-374a-4e82-af61-73b9808d1a29', '3791db6d-c837-463f-a1e8-c1705a10b56f', '0e54bcce-9991-4fbf-8798-a48a4e5c9e4d', '48b53784-7582-437e-8e02-10c27a01da59'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:35 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:13:35 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Acquiring lock "cinder-453ba29d-f60d-4269-9702-fbd2fa44aa54-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Lock "cinder-453ba29d-f60d-4269-9702-fbd2fa44aa54-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Acquiring lock "cinder-quobyte-453ba29d-f60d-4269-9702-fbd2fa44aa54" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Lock "cinder-quobyte-453ba29d-f60d-4269-9702-fbd2fa44aa54" acquired by "delete_volume" :: waited 0.033s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5723c639-e32f-4caa-95a1-5f845d17a0f6]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:36 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 Jul 07 08:13:36 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:36 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.081s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:36 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:13:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5750f220-4ce9-4b29-9260-e8afaea2243a tempest-GroupsV314Test-842799278 None] Delete group completed successfully. Jul 07 08:13:37 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54" returned: 0 in 1.312s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:37 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54 Jul 07 08:13:37 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:38 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-453ba29d-f60d-4269-9702-fbd2fa44aa54" returned: 0 in 0.800s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Lock "cinder-quobyte-453ba29d-f60d-4269-9702-fbd2fa44aa54" released by "delete_volume" :: held 2.208s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:38 devstack cinder-volume[87179]: DEBUG cinder.quota [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Created reservations ['94734abf-a730-4200-a824-3ca2e622f216', '8d114961-101d-4140-a03b-2fffcc087ea9', '59611bba-251d-4c9b-b309-06471be288dc', '37ab49de-d093-4b9d-8bce-d09e4ec05796'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:38 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:13:38 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:39 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.718s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:39 devstack cinder-volume[87179]: DEBUG cinder.manager [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:13:39 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Deleted volume successfully. Jul 07 08:13:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-8cfc31d6-42d9-4090-bd5f-0f2a3d67e9f1 req-135d38bb-0025-464a-b469-fb86a3f94ffb tempest-VolumesGetTestJSON-1793191547 None] Lock "cinder-453ba29d-f60d-4269-9702-fbd2fa44aa54-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Flow 'volume_create_manager' (94c636a1-fde2-4fb5-b571-0f62980e34e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c1ccfa-8ce8-4b2b-87d9-37c5c4b4b497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c1ccfa-8ce8-4b2b-87d9-37c5c4b4b497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1384055042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15245c54-9d97-440e-a6c7-98dfde3bb12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65140c1b99c642449f0656323cf64788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:47Z,use_quota=True,user_id='d4b50a9e321b4c2d93e858b8d462706d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fb956c-7d4e-4f5a-aec1-21b48c6da905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fb956c-7d4e-4f5a-aec1-21b48c6da905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879cd50b-6be4-480c-b0ac-23e0818fd9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879cd50b-6be4-480c-b0ac-23e0818fd9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15245c54-9d97-440e-a6c7-98dfde3bb12f', 'volume_name': 'volume-15245c54-9d97-440e-a6c7-98dfde3bb12f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7ec614-2764-493d-a491-62d70fae5b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7ec614-2764-493d-a491-62d70fae5b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34f2593-220a-4328-b3d7-ef0a1118b466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:46 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Volume 15245c54-9d97-440e-a6c7-98dfde3bb12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15245c54-9d97-440e-a6c7-98dfde3bb12f', 'volume_size': 1} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1384055042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15245c54-9d97-440e-a6c7-98dfde3bb12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65140c1b99c642449f0656323cf64788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:47Z,use_quota=True,user_id='d4b50a9e321b4c2d93e858b8d462706d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Creating volume 15245c54-9d97-440e-a6c7-98dfde3bb12f {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:13:46 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:46 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f 1073741824 Jul 07 08:13:46 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ca845388-b820-49b0-8e1d-78148fdb4306 tempest-BackendsCapabilitiesAdminTestsJSON-1874973427 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87179) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 08:13:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3c771c-51be-43a3-8151-e8f68271484a tempest-BackendsCapabilitiesAdminTestsJSON-1874973427 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87179) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 08:13:47 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f 1073741824" returned: 0 in 0.993s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:47 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f Jul 07 08:13:47 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:48 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f" returned: 0 in 0.807s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:13:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34f2593-220a-4328-b3d7-ef0a1118b466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15245c54-9d97-440e-a6c7-98dfde3bb12f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880b2e7d-7255-45ff-8ec4-48eb55725f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:48 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Volume volume-15245c54-9d97-440e-a6c7-98dfde3bb12f (15245c54-9d97-440e-a6c7-98dfde3bb12f): created successfully Jul 07 08:13:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880b2e7d-7255-45ff-8ec4-48eb55725f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Flow 'volume_create_manager' (94c636a1-fde2-4fb5-b571-0f62980e34e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:48 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-78582c21-96d0-4970-88da-d9095447c64c tempest-TaggedAttachmentsTest-1586275758 None] Created volume successfully. Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Flow 'volume_create_manager' (9a889bfe-b361-4e32-8086-199388ce331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2365ac1f-ce13-4d6f-aa1b-8f913639fa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2365ac1f-ce13-4d6f-aa1b-8f913639fa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1280405889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466f407d-eabe-4723-9b32-285a23b7968b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ded30b5a78e46df8e90232acb173c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:53Z,use_quota=True,user_id='e51701c0ec6e4413a700af2706b2f96b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eacdae6f-f3ee-45dc-a76e-e937e517c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eacdae6f-f3ee-45dc-a76e-e937e517c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614256b3-4fae-4dd5-bfbb-3d7aaa0f9637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614256b3-4fae-4dd5-bfbb-3d7aaa0f9637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466f407d-eabe-4723-9b32-285a23b7968b', 'volume_name': 'volume-466f407d-eabe-4723-9b32-285a23b7968b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447706a6-e945-4c09-9466-7841c501423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447706a6-e945-4c09-9466-7841c501423b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ff7d44-d8a1-41d4-adbe-28ce2f204fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:53 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Volume 466f407d-eabe-4723-9b32-285a23b7968b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466f407d-eabe-4723-9b32-285a23b7968b', 'volume_size': 1} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1280405889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466f407d-eabe-4723-9b32-285a23b7968b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ded30b5a78e46df8e90232acb173c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:53Z,use_quota=True,user_id='e51701c0ec6e4413a700af2706b2f96b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Creating volume 466f407d-eabe-4723-9b32-285a23b7968b {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:13:53 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:13:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:53 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b 1073741824 Jul 07 08:13:53 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:54 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b 1073741824" returned: 0 in 1.055s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:54 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b Jul 07 08:13:54 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:55 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b" returned: 0 in 1.219s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:13:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ff7d44-d8a1-41d4-adbe-28ce2f204fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466f407d-eabe-4723-9b32-285a23b7968b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779aa923-ca9d-418e-919d-52218e925670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:55 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Volume volume-466f407d-eabe-4723-9b32-285a23b7968b (466f407d-eabe-4723-9b32-285a23b7968b): created successfully Jul 07 08:13:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779aa923-ca9d-418e-919d-52218e925670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Flow 'volume_create_manager' (9a889bfe-b361-4e32-8086-199388ce331e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-845d2030-4af6-4ce3-9724-afc1ce4cc77d tempest-VolumesAdminNegativeTest-1138425126 None] Created volume successfully. Jul 07 08:13:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8a31bf2d-0864-4b50-a82a-ea55ecef3a42 tempest-GroupSnapshotsTest-309389664 None] Group tempest-GroupSnapshotsTest-Group-697039346: creating Jul 07 08:13:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8a31bf2d-0864-4b50-a82a-ea55ecef3a42 tempest-GroupSnapshotsTest-309389664 None] Group tempest-GroupSnapshotsTest-Group-697039346: created successfully Jul 07 08:13:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8a31bf2d-0864-4b50-a82a-ea55ecef3a42 tempest-GroupSnapshotsTest-309389664 None] Create group completed successfully. Jul 07 08:13:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Acquiring lock "cinder-466f407d-eabe-4723-9b32-285a23b7968b-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Lock "cinder-466f407d-eabe-4723-9b32-285a23b7968b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Acquiring lock "cinder-quobyte-466f407d-eabe-4723-9b32-285a23b7968b" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:13:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Lock "cinder-quobyte-466f407d-eabe-4723-9b32-285a23b7968b" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:13:57 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[490af32a-a0b3-4074-a792-b4652c682af9]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:13:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:57 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b Jul 07 08:13:57 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:58 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b" returned: 0 in 1.352s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:58 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b Jul 07 08:13:58 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:58 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:13:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Flow 'volume_create_manager' (ab4a6652-e79d-43ca-bda2-f476ac43c3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:13:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d945f60-34fd-44a2-994b-d2843035552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d945f60-34fd-44a2-994b-d2843035552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-608096275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9008f818-b410-47a4-a08d-0c20158f5b23,host='devstack@QuobyteHD#QuobyteHD',id=0d29acf7-9ad7-4f02-ad75-686822c271c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7292bcf22b524662b34e7ca69e0b13d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:59Z,use_quota=True,user_id='54dd44962d744acb99bbc7a36b2e1129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb88b4d-1825-404b-9ea1-01dce3dcfaa0),volume_type_id=7bb88b4d-1825-404b-9ea1-01dce3dcfaa0)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0de7c42-72ff-4f33-904f-b53344dd8ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0de7c42-72ff-4f33-904f-b53344dd8ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31bc527-3207-4ac1-83f6-1bdcad2c185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31bc527-3207-4ac1-83f6-1bdcad2c185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d29acf7-9ad7-4f02-ad75-686822c271c3', 'volume_name': 'volume-0d29acf7-9ad7-4f02-ad75-686822c271c3', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc9ebbc-0417-441a-b766-b89f149d09a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc9ebbc-0417-441a-b766-b89f149d09a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5960f85-97fa-4c94-97fa-c028e4bb6da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:13:59 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Volume 0d29acf7-9ad7-4f02-ad75-686822c271c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d29acf7-9ad7-4f02-ad75-686822c271c3', 'volume_size': 1} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9008f818-b410-47a4-a08d-0c20158f5b23,created_at=2026-07-07T06:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-608096275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9008f818-b410-47a4-a08d-0c20158f5b23,host='devstack@QuobyteHD#QuobyteHD',id=0d29acf7-9ad7-4f02-ad75-686822c271c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7292bcf22b524662b34e7ca69e0b13d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:13:59Z,use_quota=True,user_id='54dd44962d744acb99bbc7a36b2e1129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb88b4d-1825-404b-9ea1-01dce3dcfaa0),volume_type_id=7bb88b4d-1825-404b-9ea1-01dce3dcfaa0)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Creating volume 0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:13:59 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:59 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 1073741824 Jul 07 08:13:59 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:13:59 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-466f407d-eabe-4723-9b32-285a23b7968b" returned: 0 in 1.120s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Lock "cinder-quobyte-466f407d-eabe-4723-9b32-285a23b7968b" released by "delete_volume" :: held 2.548s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Created reservations ['5e7805f2-594e-4215-9ed2-f7de7c32d00e', '93c0bc05-f451-4c29-8c22-41b733e7806c', 'f066002a-213a-44cd-b1ec-b5ef74b62bc0', 'eab84813-33d3-411e-bb91-98e8283f51ba'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:13:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:13:59 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:13:59 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:00 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 1073741824" returned: 0 in 1.167s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:00 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 Jul 07 08:14:00 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:01 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.299s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:01 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Deleted volume successfully. Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3652161f-2ba9-4ca9-9278-4f1146abdd6b tempest-VolumesAdminNegativeTest-1138425126 None] Lock "cinder-466f407d-eabe-4723-9b32-285a23b7968b-delete_volume" released by "delete_volume" :: held 4.174s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:01 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3" returned: 0 in 1.096s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] <== create_volume: return (2379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.385s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5960f85-97fa-4c94-97fa-c028e4bb6da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d29acf7-9ad7-4f02-ad75-686822c271c3', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05c2ec6-a1b2-4a20-b9b8-5bce59826295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:01 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Volume volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 (0d29acf7-9ad7-4f02-ad75-686822c271c3): created successfully Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05c2ec6-a1b2-4a20-b9b8-5bce59826295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Flow 'volume_create_manager' (ab4a6652-e79d-43ca-bda2-f476ac43c3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:01 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-91003981-de1a-4dcc-aabc-203b6fe3341d tempest-GroupSnapshotsTest-309389664 None] Created volume successfully. Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Flow 'volume_create_manager' (02f1c67e-dbbe-4b34-b713-0c6c009e4b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d140a04-6edc-4d32-80f1-8ddc5e388598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d140a04-6edc-4d32-80f1-8ddc5e388598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1675746112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8260fac-1814-40ff-b5da-54040c1c2d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c2569414694834b9221d0ed9d2db6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:03Z,use_quota=True,user_id='4be45a66dcd848a9b26ce6af57ac0ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3209725-b0ae-4eba-9b62-26ea96ef35f2),volume_type_id=a3209725-b0ae-4eba-9b62-26ea96ef35f2)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ef3d39-8616-417f-a3d7-c7a7c17af0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ef3d39-8616-417f-a3d7-c7a7c17af0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ac9c39-ab4a-4786-808b-aef9b2c878c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ac9c39-ab4a-4786-808b-aef9b2c878c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8260fac-1814-40ff-b5da-54040c1c2d23', 'volume_name': 'volume-f8260fac-1814-40ff-b5da-54040c1c2d23', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7a4ac5-cb89-48a7-aa64-e6d702deaacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7a4ac5-cb89-48a7-aa64-e6d702deaacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ff357d-c9f5-46a6-a039-23f9c9596eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:03 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Volume f8260fac-1814-40ff-b5da-54040c1c2d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8260fac-1814-40ff-b5da-54040c1c2d23', 'volume_size': 1} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1675746112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8260fac-1814-40ff-b5da-54040c1c2d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c2569414694834b9221d0ed9d2db6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:03Z,use_quota=True,user_id='4be45a66dcd848a9b26ce6af57ac0ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3209725-b0ae-4eba-9b62-26ea96ef35f2),volume_type_id=a3209725-b0ae-4eba-9b62-26ea96ef35f2)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Creating volume f8260fac-1814-40ff-b5da-54040c1c2d23 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:14:03 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] GroupSnapshot d8bce6bc-105b-4753-93f3-c0ecc0c2cdd2: creating. Jul 07 08:14:03 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23 1073741824 Jul 07 08:14:03 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Group snapshot d8bce6bc-105b-4753-93f3-c0ecc0c2cdd2: creating. {{(pid=87179) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 08:14:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:14:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:04 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:14:04 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:04 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23 1073741824" returned: 0 in 1.069s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:04 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23 Jul 07 08:14:04 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:05 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:05 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23" returned: 0 in 0.660s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.681s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ff357d-c9f5-46a6-a039-23f9c9596eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8260fac-1814-40ff-b5da-54040c1c2d23', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0cae83-0948-493a-98dd-2432b7598963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Creating offline snapshot d5a57d68-085f-4c9c-bd6e-7dba11351145 of volume 0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:14:05 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Volume volume-f8260fac-1814-40ff-b5da-54040c1c2d23 (f8260fac-1814-40ff-b5da-54040c1c2d23): created successfully Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0cae83-0948-493a-98dd-2432b7598963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Flow 'volume_create_manager' (02f1c67e-dbbe-4b34-b713-0c6c009e4b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a837cb-1da7-4c1d-839f-fddcbc58aa86]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:05 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-972ca9ca-16af-44f1-94b4-f9931d03fe0a tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Created volume successfully. Jul 07 08:14:05 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 Jul 07 08:14:05 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:06 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3" returned: 0 in 0.838s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:06 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 1G Jul 07 08:14:06 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e765babf-50e9-4fbd-9770-51ce0190594d tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e765babf-50e9-4fbd-9770-51ce0190594d tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e765babf-50e9-4fbd-9770-51ce0190594d tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e765babf-50e9-4fbd-9770-51ce0190594d tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e765babf-50e9-4fbd-9770-51ce0190594d tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e765babf-50e9-4fbd-9770-51ce0190594d tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:06 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:14:06 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:07 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 1G" returned: 0 in 1.249s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:07 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 Jul 07 08:14:07 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:08 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e765babf-50e9-4fbd-9770-51ce0190594d tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.292s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-e765babf-50e9-4fbd-9770-51ce0190594d tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e765babf-50e9-4fbd-9770-51ce0190594d tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Retype volume completed successfully. Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Acquiring lock "cinder-f8260fac-1814-40ff-b5da-54040c1c2d23-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "cinder-f8260fac-1814-40ff-b5da-54040c1c2d23-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Acquiring lock "cinder-quobyte-f8260fac-1814-40ff-b5da-54040c1c2d23" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "cinder-quobyte-f8260fac-1814-40ff-b5da-54040c1c2d23" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd18f854-c9f6-431e-9bc6-7151a8618243]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:08 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23 Jul 07 08:14:08 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:08 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145" returned: 0 in 1.010s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:08 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:14:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:08 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 Jul 07 08:14:08 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:09 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145" returned: 0 in 0.705s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:09 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23" returned: 0 in 0.893s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:09 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.info Jul 07 08:14:09 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:09 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23 Jul 07 08:14:09 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:10 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:10 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.info" returned: 0 in 0.894s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f8260fac-1814-40ff-b5da-54040c1c2d23" returned: 0 in 0.871s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:10 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:10 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.info Jul 07 08:14:10 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "cinder-quobyte-f8260fac-1814-40ff-b5da-54040c1c2d23" released by "delete_volume" :: held 1.831s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:10 devstack cinder-volume[87179]: WARNING cinder.quota [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:14:10 devstack cinder-volume[87179]: WARNING cinder.quota [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Created reservations ['7d618242-ca96-4900-a63f-70446ebce02d', 'c6aa837d-fe64-44b8-a04a-8b59e6e8e8ea', '430bf525-63e5-415f-9ce5-a55d6571607f', '8516746e-2c05-4767-aba3-5139ad2bd7c2'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:10 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:14:10 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:11 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.781s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:11 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:11 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Deleted volume successfully. Jul 07 08:14:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a214a67d-19f6-4fc4-823f-7149b27a94c7 tempest-VolumeRetypeWithoutMigrationTest-2088763257 None] Lock "cinder-f8260fac-1814-40ff-b5da-54040c1c2d23-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:11 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.info" returned: 0 in 1.257s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.091s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:11 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-38bc8a49-3ec4-40f2-b709-fc353da85116 tempest-GroupSnapshotsTest-309389664 None] group_snapshot d8bce6bc-105b-4753-93f3-c0ecc0c2cdd2: created successfully Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-d5a57d68-085f-4c9c-bd6e-7dba11351145-7ec80a50-6bde-4a64-87e5-dcb209d230dd" by "_create_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-d5a57d68-085f-4c9c-bd6e-7dba11351145-7ec80a50-6bde-4a64-87e5-dcb209d230dd" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Creating volume 7ec80a50-6bde-4a64-87e5-dcb209d230dd from snapshot d5a57d68-085f-4c9c-bd6e-7dba11351145 {{(pid=87179) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-7ec80a50-6bde-4a64-87e5-dcb209d230dd" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-7ec80a50-6bde-4a64-87e5-dcb209d230dd" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] snapshot: d5a57d68-085f-4c9c-bd6e-7dba11351145, volume: 7ec80a50-6bde-4a64-87e5-dcb209d230dd, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d60f7b-bd52-4b90-a644-4cb6f9e32787]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:13 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 Jul 07 08:14:13 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:14 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145" returned: 0 in 1.130s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:14 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d29acf7-9ad7-4f02-ad75-686822c271c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:14:14 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:14:14 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:14:14 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[98df0906-e01f-4e80-9922-fab1104604cc]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:15 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 Jul 07 08:14:15 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:15 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3" returned: 0 in 1.018s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:16 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:14:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:16 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd Jul 07 08:14:16 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:23 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd" returned: 0 in 7.692s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:23 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=69,cinder:SELECT=61,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:14:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c4ed27-6bb0-4ea3-8792-541423780ab8]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:23 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=74,cinder:SELECT=60,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:14:23 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 Jul 07 08:14:23 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:24 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3" returned: 0 in 1.193s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:24 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3, size 1024.00 MB, duration 7.70 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:14:24 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Converted 1024.00 MB image at 133.05 MB/s Jul 07 08:14:24 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:14:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:24 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd Jul 07 08:14:24 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:25 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd" returned: 0 in 0.897s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-7ec80a50-6bde-4a64-87e5-dcb209d230dd" released by "_copy_volume_from_snapshot" :: held 12.071s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-d5a57d68-085f-4c9c-bd6e-7dba11351145-7ec80a50-6bde-4a64-87e5-dcb209d230dd" released by "_create_volume_from_snapshot" :: held 12.121s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.137s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3e4fb11b-f3c0-4efa-bcca-627edc712320 tempest-GroupSnapshotsTest-309389664 None] Create group from source-snapshot-d8bce6bc-105b-4753-93f3-c0ecc0c2cdd2 completed successfully. Jul 07 08:14:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-7ec80a50-6bde-4a64-87e5-dcb209d230dd" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-7ec80a50-6bde-4a64-87e5-dcb209d230dd" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde304f5-b7b2-4b4a-ab2f-9a14d1e07e57]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:27 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd Jul 07 08:14:27 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:28 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd" returned: 0 in 0.832s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:28 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd Jul 07 08:14:28 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:29 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7ec80a50-6bde-4a64-87e5-dcb209d230dd" returned: 0 in 0.745s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-7ec80a50-6bde-4a64-87e5-dcb209d230dd" released by "delete_volume" :: held 1.629s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Created reservations ['1a173e51-8e04-45e8-a1a9-64ddf70b5f34'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:29 devstack cinder-volume[87179]: WARNING cinder.quota [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-872124427 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-872124427, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:14:29 devstack cinder-volume[87179]: WARNING cinder.quota [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-872124427 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-872124427, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Created reservations ['8743c4d2-976e-48f3-a05b-e231ec5a1a5a', 'a371d8c6-3e47-477f-9611-aff32d8b5914', '506c126d-603c-44f7-b3e8-7ef23d5751ac', 'c2011182-0c4f-418e-a273-236622052f3a'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:29 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:14:29 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Flow 'volume_create_manager' (9ea00ef3-9d17-4907-896a-dd49fdf7ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6d640d-3685-4d88-92f0-46a39a439d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:30 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] group_snapshot d8bce6bc-105b-4753-93f3-c0ecc0c2cdd2: deleting Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6d640d-3685-4d88-92f0-46a39a439d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2082350541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b80cfd-b9ad-4155-a82e-9a9583af85e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a90adda9aa44daa89f28b5a3893eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:30Z,use_quota=True,user_id='348d8e5484704d78be9ca52a5503d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b5bea9-9249-4150-ace2-41ad2e2e749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b5bea9-9249-4150-ace2-41ad2e2e749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bc40cb-6b04-4dd2-9218-1824debfa188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bc40cb-6b04-4dd2-9218-1824debfa188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b80cfd-b9ad-4155-a82e-9a9583af85e1', 'volume_name': 'volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191b0aeb-ead2-44be-b0f8-8db48bde39d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191b0aeb-ead2-44be-b0f8-8db48bde39d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e96c9b-a060-4afc-aabd-20d428c19dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:30 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Volume 43b80cfd-b9ad-4155-a82e-9a9583af85e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1', 'volume_size': 1} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2082350541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b80cfd-b9ad-4155-a82e-9a9583af85e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a90adda9aa44daa89f28b5a3893eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:30Z,use_quota=True,user_id='348d8e5484704d78be9ca52a5503d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Creating volume 43b80cfd-b9ad-4155-a82e-9a9583af85e1 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:14:30 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:30 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.877s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] group_snapshot d8bce6bc-105b-4753-93f3-c0ecc0c2cdd2: deleting {{(pid=87179) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 08:14:30 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-25f1e227-028d-41cf-be73-02a873fe937c tempest-GroupSnapshotsTest-309389664 None] Delete group completed successfully. Jul 07 08:14:30 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 1073741824 Jul 07 08:14:30 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-0d29acf7-9ad7-4f02-ad75-686822c271c3" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-0d29acf7-9ad7-4f02-ad75-686822c271c3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-d5a57d68-085f-4c9c-bd6e-7dba11351145" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-d5a57d68-085f-4c9c-bd6e-7dba11351145" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Deleting offline snapshot d5a57d68-085f-4c9c-bd6e-7dba11351145 of volume 0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] snapshot_file for this snap is: volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8f3261-8f7f-4883-b50c-9d6e003e90c3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:30 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 Jul 07 08:14:30 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:31 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 1073741824" returned: 0 in 0.997s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:31 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145" returned: 0 in 0.933s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d29acf7-9ad7-4f02-ad75-686822c271c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:14:31 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 Jul 07 08:14:31 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6770129d-3477-4b70-8983-37643af4649b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:31 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 Jul 07 08:14:31 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:32 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1" returned: 0 in 0.746s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:14:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e96c9b-a060-4afc-aabd-20d428c19dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b88c449-c78e-43fc-9a19-94c4918dc416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:32 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Volume volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 (43b80cfd-b9ad-4155-a82e-9a9583af85e1): created successfully Jul 07 08:14:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b88c449-c78e-43fc-9a19-94c4918dc416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Flow 'volume_create_manager' (9ea00ef3-9d17-4907-896a-dd49fdf7ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:32 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-085d450c-78cc-466a-a642-6ae647c75f68 tempest-VolumesListAdminTestJSON-928541945 None] Created volume successfully. Jul 07 08:14:32 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3" returned: 0 in 0.880s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:32 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 Jul 07 08:14:32 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:33 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145" returned: 0 in 0.771s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:33 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145 Jul 07 08:14:33 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:34 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3.d5a57d68-085f-4c9c-bd6e-7dba11351145" returned: 0 in 0.850s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-d5a57d68-085f-4c9c-bd6e-7dba11351145" released by "_delete_snapshot" :: held 3.572s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-0d29acf7-9ad7-4f02-ad75-686822c271c3" released by "delete_snapshot" :: held 3.607s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Flow 'volume_create_manager' (07ce3f64-b740-4dbe-9525-4a84fc4815e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b513c5-b060-4154-88ed-596453449c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b513c5-b060-4154-88ed-596453449c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-258503057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13c1b32-a695-4a0f-a001-3afafe723713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a90adda9aa44daa89f28b5a3893eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:34Z,use_quota=True,user_id='348d8e5484704d78be9ca52a5503d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0359bb-3170-4319-9c4c-9f94e7d81982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0359bb-3170-4319-9c4c-9f94e7d81982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9696f253-a5d9-4896-988c-41996e91b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9696f253-a5d9-4896-988c-41996e91b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13c1b32-a695-4a0f-a001-3afafe723713', 'volume_name': 'volume-f13c1b32-a695-4a0f-a001-3afafe723713', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c998d5-94b4-41ba-8296-e666c11a3596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c998d5-94b4-41ba-8296-e666c11a3596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950905c4-2164-463c-a97c-c99d099d97fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:34 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Volume f13c1b32-a695-4a0f-a001-3afafe723713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13c1b32-a695-4a0f-a001-3afafe723713', 'volume_size': 1} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-258503057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13c1b32-a695-4a0f-a001-3afafe723713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a90adda9aa44daa89f28b5a3893eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:34Z,use_quota=True,user_id='348d8e5484704d78be9ca52a5503d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Creating volume f13c1b32-a695-4a0f-a001-3afafe723713 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:14:34 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:34 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713 1073741824 Jul 07 08:14:34 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:34 devstack cinder-volume[87179]: WARNING cinder.quota [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-872124427 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-872124427, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:14:34 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] Created reservations ['5e15265d-087c-4700-afe0-e771b653b6e4', '9e76bbe4-aed3-47bc-890b-7695c93d08f2', 'cc795ae8-7c44-4b57-a471-f5d543a9b617', '9a3f6fa8-6d7c-4f1d-8638-ecb8a2bba124'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:34 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-34ad9ee4-5722-41f4-89ea-52a88442b23a tempest-GroupSnapshotsTest-309389664 None] group_snapshot d8bce6bc-105b-4753-93f3-c0ecc0c2cdd2: deleted successfully Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-0d29acf7-9ad7-4f02-ad75-686822c271c3" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-0d29acf7-9ad7-4f02-ad75-686822c271c3" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:35 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713 1073741824" returned: 0 in 0.975s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a68fd9-c776-435d-962c-0888025f4004]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:35 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713 Jul 07 08:14:35 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:35 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 Jul 07 08:14:35 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:35 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713" returned: 0 in 0.656s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950905c4-2164-463c-a97c-c99d099d97fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13c1b32-a695-4a0f-a001-3afafe723713', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c919cf70-bbc2-43d5-99bc-49dba4cb561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Volume volume-f13c1b32-a695-4a0f-a001-3afafe723713 (f13c1b32-a695-4a0f-a001-3afafe723713): created successfully Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c919cf70-bbc2-43d5-99bc-49dba4cb561d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Flow 'volume_create_manager' (07ce3f64-b740-4dbe-9525-4a84fc4815e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:35 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-918fbeab-7716-494c-9c52-013314bcddc4 tempest-VolumesListAdminTestJSON-928541945 None] Created volume successfully. Jul 07 08:14:36 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3" returned: 0 in 0.862s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:36 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3 Jul 07 08:14:36 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Flow 'volume_create_manager' (81d63931-ab3e-4a6d-8219-18c9e031126f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c691dbed-00b9-4985-8c80-75098906e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c691dbed-00b9-4985-8c80-75098906e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-370781983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f160c0-eedc-4a77-a433-33b5f5d30fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a90adda9aa44daa89f28b5a3893eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:37Z,use_quota=True,user_id='348d8e5484704d78be9ca52a5503d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cc4613-3cc4-4a94-a91d-edc09e24df2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5cc4613-3cc4-4a94-a91d-edc09e24df2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac101c3-7857-4aab-a017-48bf0a4e1dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac101c3-7857-4aab-a017-48bf0a4e1dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f160c0-eedc-4a77-a433-33b5f5d30fbf', 'volume_name': 'volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6c229f-79e0-4117-87e3-69b2787f9a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6c229f-79e0-4117-87e3-69b2787f9a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5569ce1-6b4c-456f-870b-cf71288035e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:36 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Volume 57f160c0-eedc-4a77-a433-33b5f5d30fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf', 'volume_size': 1} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-370781983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f160c0-eedc-4a77-a433-33b5f5d30fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a90adda9aa44daa89f28b5a3893eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:37Z,use_quota=True,user_id='348d8e5484704d78be9ca52a5503d91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Creating volume 57f160c0-eedc-4a77-a433-33b5f5d30fbf {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:14:36 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:36 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf 1073741824 Jul 07 08:14:36 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:36 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0d29acf7-9ad7-4f02-ad75-686822c271c3" returned: 0 in 0.792s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-0d29acf7-9ad7-4f02-ad75-686822c271c3" released by "delete_volume" :: held 1.760s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Created reservations ['73b408e6-5eb0-4ff8-a413-63086308822e'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:36 devstack cinder-volume[87179]: WARNING cinder.db.api [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-872124427'] Jul 07 08:14:36 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Created reservations ['87ea72f4-bc16-45ed-b39e-1965c5167622', '5cc01185-d399-4401-9b07-bb5e2c835989', '279d6fa8-3243-493a-bba3-f4cb1f86d82d', '7dac79e7-2663-41a6-9759-2f61079d9c26'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:37 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:14:37 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:37 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf 1073741824" returned: 0 in 1.010s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:37 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf Jul 07 08:14:37 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:38 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.930s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:38 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1b980f9c-b213-4d94-b547-5a303a6e092b tempest-GroupSnapshotsTest-309389664 None] Delete group completed successfully. Jul 07 08:14:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f2ea3891-f7e1-456a-a5ad-e3529f7c02cf tempest-GroupSnapshotsTest-309389664 None] Group tempest-GroupSnapshotsTest-Group-349479247: creating Jul 07 08:14:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f2ea3891-f7e1-456a-a5ad-e3529f7c02cf tempest-GroupSnapshotsTest-309389664 None] Group tempest-GroupSnapshotsTest-Group-349479247: created successfully Jul 07 08:14:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f2ea3891-f7e1-456a-a5ad-e3529f7c02cf tempest-GroupSnapshotsTest-309389664 None] Create group completed successfully. Jul 07 08:14:38 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf" returned: 0 in 0.928s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:14:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5569ce1-6b4c-456f-870b-cf71288035e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd594bd9-2b1c-4a98-b04e-f36b7a178017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:38 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Volume volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf (57f160c0-eedc-4a77-a433-33b5f5d30fbf): created successfully Jul 07 08:14:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd594bd9-2b1c-4a98-b04e-f36b7a178017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Flow 'volume_create_manager' (81d63931-ab3e-4a6d-8219-18c9e031126f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5dd6a162-0d06-405b-af5c-5441666bce94 tempest-VolumesListAdminTestJSON-928541945 None] Created volume successfully. Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Flow 'volume_create_manager' (03871815-e024-4b2f-9a1d-fd0d81674902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc97b703-e03a-4f8a-acfc-21c66fa39fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc97b703-e03a-4f8a-acfc-21c66fa39fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364174567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3072cf73-313c-44e7-b1a1-3a1d06d8819f,host='devstack@QuobyteHD#QuobyteHD',id=77f3dc48-8a2c-4f06-99b2-680bcffd6c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7292bcf22b524662b34e7ca69e0b13d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:40Z,use_quota=True,user_id='54dd44962d744acb99bbc7a36b2e1129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c845d15d-6eec-49d3-b0a1-787303284c68),volume_type_id=c845d15d-6eec-49d3-b0a1-787303284c68)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ac7b5f-96b9-41dd-b544-fe717253e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ac7b5f-96b9-41dd-b544-fe717253e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe788788-e1c9-4e92-9e71-7b1055b51643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe788788-e1c9-4e92-9e71-7b1055b51643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f3dc48-8a2c-4f06-99b2-680bcffd6c09', 'volume_name': 'volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074653f8-6da8-412f-8728-1a0d53e1a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074653f8-6da8-412f-8728-1a0d53e1a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a86220b-0092-46b0-8ccd-00d1a88fe86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:40 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Volume 77f3dc48-8a2c-4f06-99b2-680bcffd6c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09', 'volume_size': 1} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3072cf73-313c-44e7-b1a1-3a1d06d8819f,created_at=2026-07-07T06:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364174567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3072cf73-313c-44e7-b1a1-3a1d06d8819f,host='devstack@QuobyteHD#QuobyteHD',id=77f3dc48-8a2c-4f06-99b2-680bcffd6c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7292bcf22b524662b34e7ca69e0b13d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:40Z,use_quota=True,user_id='54dd44962d744acb99bbc7a36b2e1129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c845d15d-6eec-49d3-b0a1-787303284c68),volume_type_id=c845d15d-6eec-49d3-b0a1-787303284c68)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Creating volume 77f3dc48-8a2c-4f06-99b2-680bcffd6c09 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:14:40 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:14:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:40 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 1073741824 Jul 07 08:14:40 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Flow 'volume_create_manager' (00c29f9e-ca40-47af-a92c-2352e45a0e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3141b7-5614-45ee-a257-94d6af43097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3141b7-5614-45ee-a257-94d6af43097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76ee032-f0ce-4179-9e70-6c910b5d10a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9dcdae68db4066b2cffec095e277de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:41Z,use_quota=True,user_id='bf4f6643d5044e10991dd483a813279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e07e06-252a-4218-93c4-391cc0f9b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e07e06-252a-4218-93c4-391cc0f9b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5c785d-ee90-4a5b-ba19-bfc6a2f87352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5c785d-ee90-4a5b-ba19-bfc6a2f87352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76ee032-f0ce-4179-9e70-6c910b5d10a8', 'volume_name': 'volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025f4503-4bca-49a9-baee-642c01ba8ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025f4503-4bca-49a9-baee-642c01ba8ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82bd705-3028-453d-a63b-f530ce1b176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:41 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Volume d76ee032-f0ce-4179-9e70-6c910b5d10a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8', 'volume_size': 1} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:41 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 1073741824" returned: 0 in 1.323s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:41 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 Jul 07 08:14:41 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:42 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" returned: 0 in 0.664s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76ee032-f0ce-4179-9e70-6c910b5d10a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9dcdae68db4066b2cffec095e277de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:41Z,use_quota=True,user_id='bf4f6643d5044e10991dd483a813279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Creating volume d76ee032-f0ce-4179-9e70-6c910b5d10a8 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:14:42 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:42 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 1073741824 Jul 07 08:14:42 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a86220b-0092-46b0-8ccd-00d1a88fe86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843e4faa-5f42-44f0-9eb0-80011ae935f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:42 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Volume volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 (77f3dc48-8a2c-4f06-99b2-680bcffd6c09): created successfully Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843e4faa-5f42-44f0-9eb0-80011ae935f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Flow 'volume_create_manager' (03871815-e024-4b2f-9a1d-fd0d81674902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:42 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-79b45c57-5d5d-4c1b-ac66-3c579d1a04c8 tempest-GroupSnapshotsTest-309389664 None] Created volume successfully. Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Flow 'volume_create_manager' (4890a2fc-f28f-4890-997c-bdd32b0361e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d9ec43-892b-487f-8d2b-6fb31849ad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d9ec43-892b-487f-8d2b-6fb31849ad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152503811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3072cf73-313c-44e7-b1a1-3a1d06d8819f,host='devstack@QuobyteHD#QuobyteHD',id=bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7292bcf22b524662b34e7ca69e0b13d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:43Z,use_quota=True,user_id='54dd44962d744acb99bbc7a36b2e1129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c845d15d-6eec-49d3-b0a1-787303284c68),volume_type_id=c845d15d-6eec-49d3-b0a1-787303284c68)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b29eba-2264-4ecb-a7df-94f170666bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b29eba-2264-4ecb-a7df-94f170666bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a770df-55c0-4e31-bc1d-9acd2b3c5040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a770df-55c0-4e31-bc1d-9acd2b3c5040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0', 'volume_name': 'volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ff0328-7a99-4ad6-8ae2-2f9e53cd2c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ff0328-7a99-4ad6-8ae2-2f9e53cd2c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837cbe23-8992-49aa-af59-ee3dd9b84e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:43 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Volume bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0', 'volume_size': 1} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:43 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 1073741824" returned: 0 in 1.241s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:43 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 Jul 07 08:14:43 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:44 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8" returned: 0 in 0.743s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.843s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3072cf73-313c-44e7-b1a1-3a1d06d8819f,created_at=2026-07-07T06:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-152503811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3072cf73-313c-44e7-b1a1-3a1d06d8819f,host='devstack@QuobyteHD#QuobyteHD',id=bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7292bcf22b524662b34e7ca69e0b13d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:14:43Z,use_quota=True,user_id='54dd44962d744acb99bbc7a36b2e1129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c845d15d-6eec-49d3-b0a1-787303284c68),volume_type_id=c845d15d-6eec-49d3-b0a1-787303284c68)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Creating volume bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:14:44 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82bd705-3028-453d-a63b-f530ce1b176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:44 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 1073741824 Jul 07 08:14:44 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa6d1a6-aef9-4106-9dee-114f639512ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:44 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Volume volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 (d76ee032-f0ce-4179-9e70-6c910b5d10a8): created successfully Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa6d1a6-aef9-4106-9dee-114f639512ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Flow 'volume_create_manager' (00c29f9e-ca40-47af-a92c-2352e45a0e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:44 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-eec1f45d-d31a-4581-af99-2893495326a0 tempest-VolumesListAdminTestJSON-1116585064 None] Created volume successfully. Jul 07 08:14:45 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 1073741824" returned: 0 in 0.879s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:45 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 Jul 07 08:14:45 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Acquiring lock "cinder-d76ee032-f0ce-4179-9e70-6c910b5d10a8-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Lock "cinder-d76ee032-f0ce-4179-9e70-6c910b5d10a8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Acquiring lock "cinder-quobyte-d76ee032-f0ce-4179-9e70-6c910b5d10a8" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Lock "cinder-quobyte-d76ee032-f0ce-4179-9e70-6c910b5d10a8" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f888048-1036-4933-874d-57531b7cf397]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "cinder-57f160c0-eedc-4a77-a433-33b5f5d30fbf-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-57f160c0-eedc-4a77-a433-33b5f5d30fbf-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "cinder-quobyte-57f160c0-eedc-4a77-a433-33b5f5d30fbf" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:46 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 Jul 07 08:14:46 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-quobyte-57f160c0-eedc-4a77-a433-33b5f5d30fbf" acquired by "delete_volume" :: waited 0.054s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a07ec-0977-494c-9a84-4ed6c739f7b6]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:46 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" returned: 0 in 1.024s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837cbe23-8992-49aa-af59-ee3dd9b84e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fdb63a-82e1-45f8-baab-3511f0959b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:14:46 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf Jul 07 08:14:46 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:46 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Volume volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 (bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0): created successfully Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fdb63a-82e1-45f8-baab-3511f0959b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:14:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Flow 'volume_create_manager' (4890a2fc-f28f-4890-997c-bdd32b0361e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:14:46 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6bf9f5ab-1bbd-48e7-8800-b1b35e849c34 tempest-GroupSnapshotsTest-309389664 None] Created volume successfully. Jul 07 08:14:47 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8" returned: 0 in 0.987s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:47 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8 Jul 07 08:14:47 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:47 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf" returned: 0 in 1.519s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:47 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf Jul 07 08:14:47 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-80102128-37f3-432c-8bb2-e8619534b3c4 tempest-GroupSnapshotsTest-309389664 None] Update group completed successfully. Jul 07 08:14:48 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d76ee032-f0ce-4179-9e70-6c910b5d10a8" returned: 0 in 1.170s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Lock "cinder-quobyte-d76ee032-f0ce-4179-9e70-6c910b5d10a8" released by "delete_volume" :: held 2.237s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Created reservations ['38f7268c-9072-452b-8a75-f3eb99e0bebc', '0a62e341-3bba-44b4-8852-489e9a74efcf', 'bf992509-2678-4de1-83b3-deefe02bf79a', '2b38d5fd-2477-42a5-b752-fde1c7a29189'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:48 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:14:48 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:48 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-57f160c0-eedc-4a77-a433-33b5f5d30fbf" returned: 0 in 0.822s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-quobyte-57f160c0-eedc-4a77-a433-33b5f5d30fbf" released by "delete_volume" :: held 2.429s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Created reservations ['1197ec84-07df-4fed-bcd6-4af9a9184180', '7783a204-fe1a-4c6d-9d87-3cc456c0167c', '82c9695f-adc7-4e66-9362-a45c50d1985c', '6546dd20-5bbb-448c-98af-10fe42a7cc77'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:48 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:14:48 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:49 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.724s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-52dfe321-42cd-4fcb-8b83-c34427b2daca tempest-GroupSnapshotsTest-309389664 None] Update group completed successfully. Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Deleted volume successfully. Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a99e5738-abb2-4f24-b215-52024123baaf tempest-VolumesListAdminTestJSON-1116585064 None] Lock "cinder-d76ee032-f0ce-4179-9e70-6c910b5d10a8-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:49 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.788s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Deleted volume successfully. Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9bf3201-474d-4a89-af41-7a97ffc8df74 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-57f160c0-eedc-4a77-a433-33b5f5d30fbf-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "cinder-f13c1b32-a695-4a0f-a001-3afafe723713-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-f13c1b32-a695-4a0f-a001-3afafe723713-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "cinder-quobyte-f13c1b32-a695-4a0f-a001-3afafe723713" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-quobyte-f13c1b32-a695-4a0f-a001-3afafe723713" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[38612d3c-2bc5-4057-afea-dbc64c9c643d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:50 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713 Jul 07 08:14:50 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6666b7aa-2058-4259-be6e-95bf3439d66f tempest-GroupSnapshotsTest-309389664 None] Update group completed successfully. Jul 07 08:14:50 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713" returned: 0 in 0.831s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:50 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713 Jul 07 08:14:50 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:51 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f13c1b32-a695-4a0f-a001-3afafe723713" returned: 0 in 0.686s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-quobyte-f13c1b32-a695-4a0f-a001-3afafe723713" released by "delete_volume" :: held 1.573s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5813955a-cc2d-484c-938e-d9d536776213 tempest-GroupSnapshotsTest-309389664 None] Update group completed successfully. Jul 07 08:14:51 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Created reservations ['1b1beaed-3993-4d72-965c-210d23fca131', '12395b06-4150-4eb6-8934-62dac6e24aca', '0b180a26-caa4-4f64-a434-eaaa3882121c', '851e7aef-a6e6-417e-ac05-2c097c088f28'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:51 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:14:51 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "cinder-43b80cfd-b9ad-4155-a82e-9a9583af85e1-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-43b80cfd-b9ad-4155-a82e-9a9583af85e1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "cinder-quobyte-43b80cfd-b9ad-4155-a82e-9a9583af85e1" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:14:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-quobyte-43b80cfd-b9ad-4155-a82e-9a9583af85e1" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:14:52 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0485cf-b3f1-401b-b268-16c6f05fbe83]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:52 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.806s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:52 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:52 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 Jul 07 08:14:52 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Deleted volume successfully. Jul 07 08:14:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-388eca8f-954b-442b-bc75-b72dbdae0206 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-f13c1b32-a695-4a0f-a001-3afafe723713-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:53 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] GroupSnapshot bd995ad3-dd6a-4f45-ab1a-14818f2f44ea: creating. Jul 07 08:14:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Group snapshot bd995ad3-dd6a-4f45-ab1a-14818f2f44ea: creating. {{(pid=87179) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 08:14:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Creating offline snapshot adef259e-3ed8-49b5-8523-d65bffcdb413 of volume 77f3dc48-8a2c-4f06-99b2-680bcffd6c09 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:14:53 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[714ee3aa-654f-422a-8afe-7cb5ff277099]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:53 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 Jul 07 08:14:53 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:53 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1" returned: 0 in 1.265s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:53 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1 Jul 07 08:14:53 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:54 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" returned: 0 in 1.037s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:54 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 1G Jul 07 08:14:54 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:54 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43b80cfd-b9ad-4155-a82e-9a9583af85e1" returned: 0 in 1.053s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-quobyte-43b80cfd-b9ad-4155-a82e-9a9583af85e1" released by "delete_volume" :: held 2.371s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Created reservations ['1fadab74-a4b3-48b7-89e5-02c3440d609c', '906da863-a0c7-4da4-b969-b9a4c06dad11', '5b537757-9c2c-4bf8-9d45-7403b8274cf2', 'c3172d6d-8388-43ac-a8de-103cf1eb44a1'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-7b301cb2-1e60-4fc9-a789-4f668d6a4529 req-cc090ff4-2141-4c6c-aaa0-7a85c5f25933 tempest-TaggedAttachmentsTest-1586275758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:54 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:14:54 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:55 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 1G" returned: 0 in 1.010s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:55 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 Jul 07 08:14:55 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:56 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.111s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:56 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:14:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Deleted volume successfully. Jul 07 08:14:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-86542a27-afa0-4a45-944b-b7c169479d73 tempest-VolumesListAdminTestJSON-928541945 None] Lock "cinder-43b80cfd-b9ad-4155-a82e-9a9583af85e1-delete_volume" released by "delete_volume" :: held 3.817s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:14:56 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413" returned: 0 in 1.142s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:56 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:14:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:56 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 Jul 07 08:14:56 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:57 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413" returned: 0 in 0.701s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:57 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.info Jul 07 08:14:57 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:58 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.info" returned: 0 in 1.112s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:58 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:14:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:58 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.info Jul 07 08:14:58 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:14:59 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Jul 07 08:14:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.info" returned: 0 in 0.873s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:14:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.015s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:14:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:14:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:14:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Creating offline snapshot fb3646f0-3cca-4f34-b397-65ad0d70e298 of volume bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:14:59 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecb177d-7d35-4463-8f92-9ac5b62513b1]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:14:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:14:59 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 Jul 07 08:14:59 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:00 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" returned: 0 in 0.855s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:00 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 1G Jul 07 08:15:00 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:01 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 1G" returned: 0 in 1.441s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:01 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 Jul 07 08:15:01 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:02 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298" returned: 0 in 0.903s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:02 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:15:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:02 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 Jul 07 08:15:02 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:03 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298" returned: 0 in 0.966s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:03 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.info Jul 07 08:15:03 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:15:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:04 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:15:04 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:04 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.info" returned: 0 in 1.136s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:04 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:15:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:04 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.info Jul 07 08:15:04 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:05 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.077s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:15:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 8 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:15:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:15:06 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.info" returned: 0 in 1.347s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.848s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-7b301cb2-1e60-4fc9-a789-4f668d6a4529 req-cc090ff4-2141-4c6c-aaa0-7a85c5f25933 tempest-TaggedAttachmentsTest-1586275758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.300s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:06 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0957488-3021-4a03-8697-331e011944a0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-7b301cb2-1e60-4fc9-a789-4f668d6a4529 req-cc090ff4-2141-4c6c-aaa0-7a85c5f25933 tempest-TaggedAttachmentsTest-1586275758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e7c1ead6-1d7b-4ef6-ba9d-01656d356079 tempest-GroupSnapshotsTest-309389664 None] group_snapshot bd995ad3-dd6a-4f45-ab1a-14818f2f44ea: created successfully Jul 07 08:15:06 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f Jul 07 08:15:06 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:07 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-7b301cb2-1e60-4fc9-a789-4f668d6a4529 req-cc090ff4-2141-4c6c-aaa0-7a85c5f25933 tempest-TaggedAttachmentsTest-1586275758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f" returned: 0 in 1.298s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-7b301cb2-1e60-4fc9-a789-4f668d6a4529 req-cc090ff4-2141-4c6c-aaa0-7a85c5f25933 tempest-TaggedAttachmentsTest-1586275758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.373s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-7b301cb2-1e60-4fc9-a789-4f668d6a4529 req-cc090ff4-2141-4c6c-aaa0-7a85c5f25933 tempest-TaggedAttachmentsTest-1586275758 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-15245c54-9d97-440e-a6c7-98dfde3bb12f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '754a7c42-b407-440c-9238-c23ee3640d8f', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:15:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] group_snapshot bd995ad3-dd6a-4f45-ab1a-14818f2f44ea: deleting Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] group_snapshot bd995ad3-dd6a-4f45-ab1a-14818f2f44ea: deleting {{(pid=87179) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-adef259e-3ed8-49b5-8523-d65bffcdb413" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-7b301cb2-1e60-4fc9-a789-4f668d6a4529 req-cc090ff4-2141-4c6c-aaa0-7a85c5f25933 tempest-TaggedAttachmentsTest-1586275758 None] attachment_update completed successfully. Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-adef259e-3ed8-49b5-8523-d65bffcdb413" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Deleting offline snapshot adef259e-3ed8-49b5-8523-d65bffcdb413 of volume 77f3dc48-8a2c-4f06-99b2-680bcffd6c09 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] snapshot_file for this snap is: volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadb5fde-93b7-4f5a-bdf0-616ef7ba3745]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:08 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 Jul 07 08:15:08 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:09 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413" returned: 0 in 1.689s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:09 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:15:09 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e21bd96-367d-4aef-b33f-2e42fc129444]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:09 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 Jul 07 08:15:09 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Flow 'volume_create_manager' (51e7693b-f861-488d-a039-0cbdec04b3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed5876e-531f-4cc3-83d7-a20eed5413a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed5876e-531f-4cc3-83d7-a20eed5413a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1388177438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d08df4-01eb-4a08-8657-21ebc3ff1091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edf118cdced4a7aa0c2df3255593726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:10Z,use_quota=True,user_id='0513623f4ecf402aa8cc5b1b58fb838d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb363add-a45a-45e7-acc1-c9a747f0a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb363add-a45a-45e7-acc1-c9a747f0a807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34075d1-9adf-4948-a08a-dcf97ccb38d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34075d1-9adf-4948-a08a-dcf97ccb38d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d08df4-01eb-4a08-8657-21ebc3ff1091', 'volume_name': 'volume-00d08df4-01eb-4a08-8657-21ebc3ff1091', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcdd02f-80d9-4e75-960f-5388af983ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcdd02f-80d9-4e75-960f-5388af983ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fc5016-ffb6-47b0-b133-3e776eedd44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:10 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Volume 00d08df4-01eb-4a08-8657-21ebc3ff1091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d08df4-01eb-4a08-8657-21ebc3ff1091', 'volume_size': 1} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1388177438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d08df4-01eb-4a08-8657-21ebc3ff1091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edf118cdced4a7aa0c2df3255593726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:10Z,use_quota=True,user_id='0513623f4ecf402aa8cc5b1b58fb838d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Creating volume 00d08df4-01eb-4a08-8657-21ebc3ff1091 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:15:10 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:10 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 1073741824 Jul 07 08:15:10 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:10 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" returned: 0 in 1.328s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:10 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 Jul 07 08:15:10 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:11 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413" returned: 0 in 0.903s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:11 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413 Jul 07 08:15:11 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:11 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 1073741824" returned: 0 in 1.130s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:11 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 Jul 07 08:15:11 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:12 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09.adef259e-3ed8-49b5-8523-d65bffcdb413" returned: 0 in 0.711s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-adef259e-3ed8-49b5-8523-d65bffcdb413" released by "_delete_snapshot" :: held 4.796s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" released by "delete_snapshot" :: held 4.839s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-fb3646f0-3cca-4f34-b397-65ad0d70e298" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-fb3646f0-3cca-4f34-b397-65ad0d70e298" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Deleting offline snapshot fb3646f0-3cca-4f34-b397-65ad0d70e298 of volume bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] snapshot_file for this snap is: volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9970cc24-7116-4d6c-bacd-aba1ca7b706e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:12 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091" returned: 0 in 0.917s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fc5016-ffb6-47b0-b133-3e776eedd44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d08df4-01eb-4a08-8657-21ebc3ff1091', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5988e3-4212-4d81-a3fa-bbffcc460974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:12 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Volume volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 (00d08df4-01eb-4a08-8657-21ebc3ff1091): created successfully Jul 07 08:15:12 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 Jul 07 08:15:12 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5988e3-4212-4d81-a3fa-bbffcc460974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Flow 'volume_create_manager' (51e7693b-f861-488d-a039-0cbdec04b3a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:12 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-42e4e103-b7ef-4595-a960-631ab455ca57 tempest-VolumesTransfersV355Test-105951700 None] Created volume successfully. Jul 07 08:15:13 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298" returned: 0 in 1.076s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:15:13 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b3abbe-5ca0-44e9-8c03-9bca9b9b2dff]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:13 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 Jul 07 08:15:13 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a6c9ebdc-1e76-49d3-a101-d9072c64d24b tempest-VolumesTransfersV355Test-1203281285 None] Transfer volume completed successfully. Jul 07 08:15:14 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" returned: 0 in 0.969s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:14 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 Jul 07 08:15:14 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Acquiring lock "cinder-00d08df4-01eb-4a08-8657-21ebc3ff1091-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Lock "cinder-00d08df4-01eb-4a08-8657-21ebc3ff1091-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Acquiring lock "cinder-quobyte-00d08df4-01eb-4a08-8657-21ebc3ff1091" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Lock "cinder-quobyte-00d08df4-01eb-4a08-8657-21ebc3ff1091" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:15 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[56244371-031e-4dfc-893c-819a235fca8f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:15 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298" returned: 0 in 0.964s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:15 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-27d7a412-68a7-49e8-8660-06ce9772df76 req-075a5cc6-7848-419d-96e6-dcd5dd1d82a9 tempest-TaggedAttachmentsTest-1586275758 None] Terminate volume connection completed successfully. Jul 07 08:15:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-27d7a412-68a7-49e8-8660-06ce9772df76 req-075a5cc6-7848-419d-96e6-dcd5dd1d82a9 tempest-TaggedAttachmentsTest-1586275758 None] Deleting attachment 754a7c42-b407-440c-9238-c23ee3640d8f. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:15:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:15 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 Jul 07 08:15:15 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:15 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298 Jul 07 08:15:15 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:16 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0.fb3646f0-3cca-4f34-b397-65ad0d70e298" returned: 0 in 0.678s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:16 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091" returned: 0 in 0.861s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-fb3646f0-3cca-4f34-b397-65ad0d70e298" released by "_delete_snapshot" :: held 3.834s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" released by "delete_snapshot" :: held 3.864s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:16 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091 Jul 07 08:15:16 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:16 devstack cinder-volume[87179]: WARNING cinder.quota [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-371535246 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-371535246, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:15:16 devstack cinder-volume[87179]: WARNING cinder.quota [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-371535246 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-371535246, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:15:16 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Created reservations ['adbb6374-5716-4989-b750-7c422b3ebcf4', '2349392d-0f2a-45cc-8094-1fc3465687f9', 'e61e1d78-6862-4e8a-8897-f1e837bf296f', '7ece8080-01ff-474f-853d-9928cdf1cfa3'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:16 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] Created reservations ['982fd6fe-9b7d-440d-a174-58cc2306e394', 'e30c77bb-c269-4cd8-8b74-aa6f2b84ae4a', 'a8f20a26-2789-4196-8b08-7857a702268d', 'f4cfb10e-c692-452e-82ed-83cb95f33a49'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:16 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-39e41744-34b7-4c71-bc7c-572a9d3656b8 tempest-GroupSnapshotsTest-309389664 None] group_snapshot bd995ad3-dd6a-4f45-ab1a-14818f2f44ea: deleted successfully Jul 07 08:15:17 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-00d08df4-01eb-4a08-8657-21ebc3ff1091" returned: 0 in 0.984s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Lock "cinder-quobyte-00d08df4-01eb-4a08-8657-21ebc3ff1091" released by "delete_volume" :: held 1.908s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51f3dc-4d8e-43f7-b4a7-8c794f643063]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Created reservations ['e332f3c1-2078-4e3c-8132-d3108f6223ae', '99aeeee1-f02c-4d7c-a58c-dc0dd3c4e294', '5c168c9d-8375-4c6a-80a5-d3b6b0121836', '2e4165ea-6d81-45d3-a502-b052d75c50c0'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:17 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:15:17 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:17 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 Jul 07 08:15:17 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Flow 'volume_create_manager' (400163fa-e46a-452e-a447-522353cedd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec49cd0-9bfc-4029-8f98-f5231c5f2ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec49cd0-9bfc-4029-8f98-f5231c5f2ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-327464293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eef612c-da42-4a80-bd52-e985e622eb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edf118cdced4a7aa0c2df3255593726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:19Z,use_quota=True,user_id='0513623f4ecf402aa8cc5b1b58fb838d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f8492b-e7c8-4db3-9b34-da337eb638c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f8492b-e7c8-4db3-9b34-da337eb638c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4626c7-7d0d-4549-bdbb-0942bdfefe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4626c7-7d0d-4549-bdbb-0942bdfefe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eef612c-da42-4a80-bd52-e985e622eb0c', 'volume_name': 'volume-2eef612c-da42-4a80-bd52-e985e622eb0c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645f68ac-586c-4279-ae2d-c42ca2214c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645f68ac-586c-4279-ae2d-c42ca2214c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e5e9e1-1045-4e32-9c0b-4bf714db5237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:18 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Volume 2eef612c-da42-4a80-bd52-e985e622eb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eef612c-da42-4a80-bd52-e985e622eb0c', 'volume_size': 1} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-327464293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eef612c-da42-4a80-bd52-e985e622eb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edf118cdced4a7aa0c2df3255593726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:19Z,use_quota=True,user_id='0513623f4ecf402aa8cc5b1b58fb838d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Creating volume 2eef612c-da42-4a80-bd52-e985e622eb0c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:15:18 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:18 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.271s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:18 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c 1073741824 Jul 07 08:15:18 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:18 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Deleted volume successfully. Jul 07 08:15:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06889fa3-009e-4d24-ad45-b8abb03377f4 tempest-VolumesTransfersV355Test-783291502 None] Lock "cinder-00d08df4-01eb-4a08-8657-21ebc3ff1091-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:19 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" returned: 0 in 1.515s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:19 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09 Jul 07 08:15:19 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:20 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" returned: 0 in 1.558s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:20 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c 1073741824" returned: 0 in 1.839s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-77f3dc48-8a2c-4f06-99b2-680bcffd6c09" released by "delete_volume" :: held 3.243s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" acquired by "delete_volume" :: waited 0.047s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Flow 'volume_create_manager' (4d55a9fd-9071-43a6-a784-d37b547fb12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ae049e-d9dc-44be-a6a3-aef5ecf98de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9428b01-bee5-449a-9bc7-fc5402fe58ea]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ae049e-d9dc-44be-a6a3-aef5ecf98de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1998567858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58589775-669c-425e-b932-c53fba7fd375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fae02ceafd546a7bf524c1983c66df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:21Z,use_quota=True,user_id='74a0164b78b243379a4529aac50d3444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f26db1-9513-44a3-a13b-866b39aec490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f26db1-9513-44a3-a13b-866b39aec490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d8ab24-8bbf-4287-9c29-18ede5a5f309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d8ab24-8bbf-4287-9c29-18ede5a5f309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58589775-669c-425e-b932-c53fba7fd375', 'volume_name': 'volume-58589775-669c-425e-b932-c53fba7fd375', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ca7ed3-5351-4ea3-8b72-547c9988ba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ca7ed3-5351-4ea3-8b72-547c9988ba7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38eb8435-7be4-4bda-8e48-b2a048dba07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:21 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Volume 58589775-669c-425e-b932-c53fba7fd375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58589775-669c-425e-b932-c53fba7fd375', 'volume_size': 1} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:21 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c Jul 07 08:15:21 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:21 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 Jul 07 08:15:21 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:22 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c" returned: 0 in 0.985s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] <== create_volume: return (3295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.299s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.995s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1998567858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58589775-669c-425e-b932-c53fba7fd375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fae02ceafd546a7bf524c1983c66df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:21Z,use_quota=True,user_id='74a0164b78b243379a4529aac50d3444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Creating volume 58589775-669c-425e-b932-c53fba7fd375 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:15:22 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e5e9e1-1045-4e32-9c0b-4bf714db5237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eef612c-da42-4a80-bd52-e985e622eb0c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:22 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375 1073741824 Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109c1f23-5a90-4d9c-a0be-f4e53fc14011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:22 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:22 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Volume volume-2eef612c-da42-4a80-bd52-e985e622eb0c (2eef612c-da42-4a80-bd52-e985e622eb0c): created successfully Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109c1f23-5a90-4d9c-a0be-f4e53fc14011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Flow 'volume_create_manager' (400163fa-e46a-452e-a447-522353cedd10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:22 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e663b0cc-85d7-474c-bf00-0c3280fe876f tempest-VolumesTransfersV355Test-105951700 None] Created volume successfully. Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" returned: 0 in 1.324s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:22 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0 Jul 07 08:15:22 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:23 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" returned: 0 in 0.760s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-bcdabb9f-21cc-4bac-8d05-29e6fa0d08c0" released by "delete_volume" :: held 2.316s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Created reservations ['6806f526-b23e-449f-9ef9-6486bb6e3885'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:23 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375 1073741824" returned: 0 in 1.071s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:23 devstack cinder-volume[87179]: WARNING cinder.quota [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-371535246 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-371535246, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:23 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375 Jul 07 08:15:23 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Created reservations ['653ad410-1c3d-48d0-94d1-a08023e34545', '890ed330-6dc2-4c2b-81b6-83870e0bf25d', '4c331990-ec98-4e36-9ade-56db7118fb65', '5b0351ec-ca36-4c4c-aafc-7651d3ab1507'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Created reservations ['c467d255-9999-4ef2-b361-cac3147195a7', 'c07423d2-cc6d-4129-97de-a08c4c7f1c84', '3ba885ae-61a8-482a-a6a5-97e49be97788', '1ee3acd0-9c30-4ac9-9cd8-c586b697106f'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Acquiring lock "cinder-2eef612c-da42-4a80-bd52-e985e622eb0c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Lock "cinder-2eef612c-da42-4a80-bd52-e985e622eb0c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:23 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=138,cinder:SELECT=105,cinder:INSERT=33,cinder:DELETE=8 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:15:23 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Acquiring lock "cinder-quobyte-2eef612c-da42-4a80-bd52-e985e622eb0c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Lock "cinder-quobyte-2eef612c-da42-4a80-bd52-e985e622eb0c" acquired by "delete_volume" :: waited 0.043s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd31bb-cffc-4144-a454-c778eeb23d05]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:24 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c Jul 07 08:15:24 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:24 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375" returned: 0 in 1.319s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] <== create_volume: return (2463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:15:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38eb8435-7be4-4bda-8e48-b2a048dba07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58589775-669c-425e-b932-c53fba7fd375', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a79a698e-d080-4bef-b603-b443a40d519b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:24 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Volume volume-58589775-669c-425e-b932-c53fba7fd375 (58589775-669c-425e-b932-c53fba7fd375): created successfully Jul 07 08:15:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a79a698e-d080-4bef-b603-b443a40d519b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Flow 'volume_create_manager' (4d55a9fd-9071-43a6-a784-d37b547fb12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:24 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=133,cinder:UPDATE=134,cinder:INSERT=29,cinder:DELETE=5 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:15:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f19b670b-8b57-405c-afc6-86338cb4c486 tempest-ServerRescueNegativeTestJSON-1610878873 None] Created volume successfully. Jul 07 08:15:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e0aab3a5-3d37-4bff-b889-ae4444144f26 tempest-GroupSnapshotsTest-309389664 None] Group tempest-GroupSnapshotsTest-Group-568319354: creating Jul 07 08:15:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e0aab3a5-3d37-4bff-b889-ae4444144f26 tempest-GroupSnapshotsTest-309389664 None] Group tempest-GroupSnapshotsTest-Group-568319354: created successfully Jul 07 08:15:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e0aab3a5-3d37-4bff-b889-ae4444144f26 tempest-GroupSnapshotsTest-309389664 None] Create group completed successfully. Jul 07 08:15:25 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.410s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:25 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7a8c63c0-34ee-4ae8-874f-e5f5675b7d5f tempest-GroupSnapshotsTest-309389664 None] Delete group completed successfully. Jul 07 08:15:25 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c" returned: 0 in 1.288s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:25 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c Jul 07 08:15:25 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:25 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2eef612c-da42-4a80-bd52-e985e622eb0c" returned: 0 in 0.758s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Lock "cinder-quobyte-2eef612c-da42-4a80-bd52-e985e622eb0c" released by "delete_volume" :: held 2.119s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Created reservations ['844d6588-455a-44da-9b28-5a62d77e5d4b', '6633c385-2c51-432b-9978-eda839e92776', 'bd208ba5-5f4d-456d-9e8b-8e31fceb0e99', 'a75948cc-9b40-46cc-a1d8-b313e3394c5e'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:26 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:15:26 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Flow 'volume_create_manager' (83f669fb-06da-495e-a061-d67ed0f1ad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abedc36-59d4-415f-99a0-a0a760e605f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abedc36-59d4-415f-99a0-a0a760e605f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1845463431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b917243-dffb-42d2-9d71-47b27028b067,host='devstack@QuobyteHD#QuobyteHD',id=de72a24a-e816-4e7d-86fb-6ef7f69aa69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7292bcf22b524662b34e7ca69e0b13d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:27Z,use_quota=True,user_id='54dd44962d744acb99bbc7a36b2e1129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90e46d11-e6f9-4587-9f74-88245825bd83),volume_type_id=90e46d11-e6f9-4587-9f74-88245825bd83)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8222d703-ee8c-4864-bef5-a4e050147314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8222d703-ee8c-4864-bef5-a4e050147314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a992274-4ed9-40e9-aa0e-8264822889f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a992274-4ed9-40e9-aa0e-8264822889f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de72a24a-e816-4e7d-86fb-6ef7f69aa69a', 'volume_name': 'volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399030c2-bd30-43b0-8cfd-534d7e652dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399030c2-bd30-43b0-8cfd-534d7e652dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fade17-512d-4782-b145-72b6c80fbb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:26 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Volume de72a24a-e816-4e7d-86fb-6ef7f69aa69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a', 'volume_size': 1} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b917243-dffb-42d2-9d71-47b27028b067,created_at=2026-07-07T06:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1845463431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b917243-dffb-42d2-9d71-47b27028b067,host='devstack@QuobyteHD#QuobyteHD',id=de72a24a-e816-4e7d-86fb-6ef7f69aa69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7292bcf22b524662b34e7ca69e0b13d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:27Z,use_quota=True,user_id='54dd44962d744acb99bbc7a36b2e1129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90e46d11-e6f9-4587-9f74-88245825bd83),volume_type_id=90e46d11-e6f9-4587-9f74-88245825bd83)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Creating volume de72a24a-e816-4e7d-86fb-6ef7f69aa69a {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:15:26 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:15:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:26 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a 1073741824 Jul 07 08:15:26 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:27 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.143s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:27 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:27 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Deleted volume successfully. Jul 07 08:15:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c012cebb-85ac-4afd-b9f1-1136c12ce040 tempest-VolumesTransfersV355Test-783291502 None] Lock "cinder-2eef612c-da42-4a80-bd52-e985e622eb0c-delete_volume" released by "delete_volume" :: held 3.821s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:28 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a 1073741824" returned: 0 in 1.642s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:28 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a Jul 07 08:15:28 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:29 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" returned: 0 in 1.256s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] <== create_volume: return (2986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:15:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.989s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fade17-512d-4782-b145-72b6c80fbb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b965d78c-9d8f-4867-844b-2ef97d7cbbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:29 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Volume volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a (de72a24a-e816-4e7d-86fb-6ef7f69aa69a): created successfully Jul 07 08:15:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b965d78c-9d8f-4867-844b-2ef97d7cbbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Flow 'volume_create_manager' (83f669fb-06da-495e-a061-d67ed0f1ad69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-72dd5f72-3f3e-40b6-98d6-65a944919a15 tempest-GroupSnapshotsTest-309389664 None] Created volume successfully. Jul 07 08:15:30 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] GroupSnapshot b21a0291-a349-463a-86f3-3e3b1d0062dc: creating. Jul 07 08:15:30 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Group snapshot b21a0291-a349-463a-86f3-3e3b1d0062dc: creating. {{(pid=87179) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 08:15:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Creating offline snapshot 2e82b128-7f01-4884-b67f-cfd34666fad0 of volume de72a24a-e816-4e7d-86fb-6ef7f69aa69a {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:15:30 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a34121f-b1d6-42c1-b554-c97359563cc2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:31 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a Jul 07 08:15:31 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:32 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" returned: 0 in 1.105s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:32 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 1G Jul 07 08:15:32 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:33 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 1G" returned: 0 in 1.041s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:33 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 Jul 07 08:15:33 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:33 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0" returned: 0 in 0.785s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:33 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:15:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:33 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 Jul 07 08:15:33 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:34 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0" returned: 0 in 0.695s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:34 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.info Jul 07 08:15:34 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:35 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.info" returned: 0 in 0.724s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:35 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:15:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:35 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.info Jul 07 08:15:35 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.info" returned: 0 in 0.802s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:36 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.310s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b10dbbf2-35a7-4d39-bad4-6cf3bf4f0166 tempest-GroupSnapshotsTest-309389664 None] group_snapshot b21a0291-a349-463a-86f3-3e3b1d0062dc: created successfully Jul 07 08:15:36 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:15:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Flow 'volume_create_manager' (5a2ca211-9325-46d1-9794-0ea517e718ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65a80f8-fe3c-4a9d-9452-0677766539d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65a80f8-fe3c-4a9d-9452-0677766539d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-439080562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e471ef12-4065-40e0-a64a-420b9d09839f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3899f339f0fd4dc6896c6b7c41c5d70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:37Z,use_quota=True,user_id='f60cda450d4e4ed3ac707ece9e116ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c087abb1-501c-428a-90a0-1b96e1c53935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c087abb1-501c-428a-90a0-1b96e1c53935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba71f73f-b516-4818-b4d5-85f07f263e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.image.glance [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Creating Keystone auth plugin from conf {{(pid=87179) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:15:37 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] group_snapshot b21a0291-a349-463a-86f3-3e3b1d0062dc: deleting Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba71f73f-b516-4818-b4d5-85f07f263e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e471ef12-4065-40e0-a64a-420b9d09839f', 'volume_name': 'volume-e471ef12-4065-40e0-a64a-420b9d09839f', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75aa253f-84d6-4595-b369-8e4f3db8d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75aa253f-84d6-4595-b369-8e4f3db8d001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0809ca64-602a-4da7-9b3c-d945d2ba2ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:37 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Volume e471ef12-4065-40e0-a64a-420b9d09839f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e471ef12-4065-40e0-a64a-420b9d09839f', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Trying to clone e471ef12-4065-40e0-a64a-420b9d09839f from image d183b53e-6225-438a-8e28-29fd7f440861 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]). {{(pid=87179) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] group_snapshot b21a0291-a349-463a-86f3-3e3b1d0062dc: deleting {{(pid=87179) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-2e82b128-7f01-4884-b67f-cfd34666fad0" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-2e82b128-7f01-4884-b67f-cfd34666fad0" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Deleting offline snapshot 2e82b128-7f01-4884-b67f-cfd34666fad0 of volume de72a24a-e816-4e7d-86fb-6ef7f69aa69a {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] snapshot_file for this snap is: volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:15:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3e8e70-a963-49bb-88f7-a5658583e854]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:38 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 Jul 07 08:15:38 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:38 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:15:38 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Image download 20.69 MB at 20.69 MB/s Jul 07 08:15:38 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad92f29-c77b-4a2d-b1d6-af62c7a49a1d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:39 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD Jul 07 08:15:39 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Acquiring lock "cinder-15245c54-9d97-440e-a6c7-98dfde3bb12f-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Lock "cinder-15245c54-9d97-440e-a6c7-98dfde3bb12f-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Acquiring lock "cinder-quobyte-15245c54-9d97-440e-a6c7-98dfde3bb12f" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Lock "cinder-quobyte-15245c54-9d97-440e-a6c7-98dfde3bb12f" acquired by "delete_volume" :: waited 0.051s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:39 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0" returned: 0 in 1.576s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e11e051-703e-4df1-868b-86e5463b471a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f5d98a-5859-4ff1-b9b8-0498212e6287]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:39 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f Jul 07 08:15:39 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:39 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a Jul 07 08:15:39 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:40 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD" returned: 0 in 1.508s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:40 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Temporary image d183b53e-6225-438a-8e28-29fd7f440861 is fetched for user f60cda450d4e4ed3ac707ece9e116ff4. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:15:40 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbfbae6-5fb3-4e98-adc3-dee9c82718bd]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:40 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD Jul 07 08:15:40 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:40 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f" returned: 0 in 1.344s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:41 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f Jul 07 08:15:41 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:41 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" returned: 0 in 1.483s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:41 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 Jul 07 08:15:41 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:42 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD" returned: 0 in 1.754s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-439080562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e471ef12-4065-40e0-a64a-420b9d09839f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3899f339f0fd4dc6896c6b7c41c5d70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:15:37Z,use_quota=True,user_id='f60cda450d4e4ed3ac707ece9e116ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Creating volume e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:15:42 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:42 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f 1073741824 Jul 07 08:15:42 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:42 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-15245c54-9d97-440e-a6c7-98dfde3bb12f" returned: 0 in 1.400s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Lock "cinder-quobyte-15245c54-9d97-440e-a6c7-98dfde3bb12f" released by "delete_volume" :: held 2.844s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Created reservations ['9051b3a8-71f7-4b83-b9ff-14a76ba0b8ff', '84159e0f-6cfc-4ef1-b946-54f096d7dfdf', '64b59f9f-4ac8-476f-8ce5-8af5011d44fa', '3320e1fc-c58d-4c75-a5b2-c9160a32ef5d'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:42 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0" returned: 0 in 1.464s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:42 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:15:42 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:42 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0 Jul 07 08:15:42 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:43 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f 1073741824" returned: 0 in 0.980s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:43 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f Jul 07 08:15:43 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:43 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.746s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:43 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Deleted volume successfully. Jul 07 08:15:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-22bffae9-e325-411d-8416-32bdb5074526 tempest-TaggedAttachmentsTest-1586275758 None] Lock "cinder-15245c54-9d97-440e-a6c7-98dfde3bb12f-delete_volume" released by "delete_volume" :: held 3.990s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:43 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a.2e82b128-7f01-4884-b67f-cfd34666fad0" returned: 0 in 0.794s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-2e82b128-7f01-4884-b67f-cfd34666fad0" released by "_delete_snapshot" :: held 5.583s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" released by "delete_snapshot" :: held 5.638s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:43 devstack cinder-volume[87179]: WARNING cinder.quota [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1803652054 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1803652054, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:15:43 devstack cinder-volume[87179]: WARNING cinder.quota [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1803652054 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1803652054, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:15:43 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] Created reservations ['fafa9646-40fd-435e-8472-8a4d9ecf922c', 'f3495221-d883-465d-a6c4-bf497f0738c1', 'f739bf34-378b-463c-b1d9-ed01be91a113', '5f729e54-148f-4050-a3f7-4213a7f33b5f'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5ea93712-ea66-44f0-82dc-2e7a3bc4e6f2 tempest-GroupSnapshotsTest-309389664 None] group_snapshot b21a0291-a349-463a-86f3-3e3b1d0062dc: deleted successfully Jul 07 08:15:44 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f" returned: 0 in 0.871s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Attempting download of d183b53e-6225-438a-8e28-29fd7f440861 ((None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}])) to volume e471ef12-4065-40e0-a64a-420b9d09839f. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61dea29-73fa-482a-b2a3-7c3e2a49b46d]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_7l0nq1yi {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:44 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_7l0nq1yi Jul 07 08:15:44 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "cinder-quobyte-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9726ad85-6ff6-420a-bd35-e88c6c081e9d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:45 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a Jul 07 08:15:45 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:45 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_7l0nq1yi" returned: 0 in 1.094s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_7l0nq1yi {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:45 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_7l0nq1yi Jul 07 08:15:45 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Acquiring lock "cinder-58589775-669c-425e-b932-c53fba7fd375-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "cinder-58589775-669c-425e-b932-c53fba7fd375-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Acquiring lock "cinder-quobyte-58589775-669c-425e-b932-c53fba7fd375" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:15:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "cinder-quobyte-58589775-669c-425e-b932-c53fba7fd375" acquired by "delete_volume" :: waited 0.042s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:15:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ba7371-ad0e-4c65-97eb-b39f9b97e532]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:46 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375 Jul 07 08:15:46 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:46 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" returned: 0 in 1.871s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:46 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a Jul 07 08:15:46 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:47 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_7l0nq1yi" returned: 1 in 1.745s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_7l0nq1yi' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:15:47 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45c024f-3cf5-4bfc-837c-4de527ce1825]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:47 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD Jul 07 08:15:47 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:47 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375" returned: 0 in 1.636s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:47 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375 Jul 07 08:15:47 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:48 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" returned: 0 in 1.427s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Lock "cinder-quobyte-de72a24a-e816-4e7d-86fb-6ef7f69aa69a" released by "delete_volume" :: held 3.434s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Created reservations ['1d0d2cdb-d6b6-49ba-9e52-a52a747a0476'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:48 devstack cinder-volume[87179]: WARNING cinder.quota [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1803652054 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1803652054, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Created reservations ['7b4b37be-5fb3-4e97-a2be-eaa26a31c99a', 'cb47e8d9-90a4-4aa4-9375-0f3ee9c9c0ec', 'a065f3cb-8e47-40b2-8e42-fc2e00e92919', 'c5cd3db9-1b46-444e-8bc1-13fc59c1b9a3'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:48 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD" returned: 0 in 1.450s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] d183b53e-6225-438a-8e28-29fd7f440861 was qcow2, converting to raw {{(pid=87179) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:48 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f Jul 07 08:15:48 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:48 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:15:48 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:48 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-58589775-669c-425e-b932-c53fba7fd375" returned: 0 in 1.158s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "cinder-quobyte-58589775-669c-425e-b932-c53fba7fd375" released by "delete_volume" :: held 2.890s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:49 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Created reservations ['07a03b33-4680-44d3-aa72-ef59523b9592', '4a57b821-b0fa-40b1-8111-937b3cd83761', 'ea5fb679-89c4-4550-acfb-650eb04a8dca', '4cc072ce-1405-4c5a-82da-a1b16c1f75ce'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:15:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:15:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:15:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:49 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:15:49 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:50 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.515s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:50 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6e5f81cc-a13f-459f-9a56-211b2735aba2 tempest-GroupSnapshotsTest-309389664 None] Delete group completed successfully. Jul 07 08:15:51 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.738s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:51 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:15:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Deleted volume successfully. Jul 07 08:15:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2adf6bc6-7521-4ba7-9234-fd2187c73ba7 tempest-ServerRescueNegativeTestJSON-1610878873 None] Lock "cinder-58589775-669c-425e-b932-c53fba7fd375-delete_volume" released by "delete_volume" :: held 5.061s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:15:52 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f" returned: 0 in 3.875s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:52 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_taf2it1_devstack@QuobyteHD, size 112.00 MB, duration 3.88 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:15:52 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Converted 112.00 MB image at 28.90 MB/s Jul 07 08:15:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:52 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f 1G Jul 07 08:15:52 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:53 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f 1G" returned: 0 in 1.207s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:53 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5b4b66-eafd-48ab-9a03-57d4a567012d]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:53 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f Jul 07 08:15:53 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:54 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f" returned: 0 in 1.023s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:54 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f Jul 07 08:15:54 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:55 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f" returned: 1 in 1.223s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:15:55 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Downloaded image d183b53e-6225-438a-8e28-29fd7f440861 ((None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}])) to volume e471ef12-4065-40e0-a64a-420b9d09839f successfully. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:15:55 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Temporary image d183b53e-6225-438a-8e28-29fd7f440861 for user f60cda450d4e4ed3ac707ece9e116ff4 is deleted. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:15:55 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Marking volume e471ef12-4065-40e0-a64a-420b9d09839f as bootable. {{(pid=87179) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:15:55 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Copying metadata from image d183b53e-6225-438a-8e28-29fd7f440861 to e471ef12-4065-40e0-a64a-420b9d09839f. {{(pid=87179) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:15:55 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Creating volume glance metadata for volume e471ef12-4065-40e0-a64a-420b9d09839f backed by image d183b53e-6225-438a-8e28-29fd7f440861 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87179) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:15:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0809ca64-602a-4da7-9b3c-d945d2ba2ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e471ef12-4065-40e0-a64a-420b9d09839f', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c04aa2-984c-4fe1-89e2-e6931e392b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:15:56 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Volume volume-e471ef12-4065-40e0-a64a-420b9d09839f (e471ef12-4065-40e0-a64a-420b9d09839f): created successfully Jul 07 08:15:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c04aa2-984c-4fe1-89e2-e6931e392b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:15:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Flow 'volume_create_manager' (5a2ca211-9325-46d1-9794-0ea517e718ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:15:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-40aaa158-6c5c-4aa9-8bd7-90cac26188f4 tempest-VolumesExtendTest-58136998 None] Created volume successfully. Jul 07 08:15:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:15:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:15:57 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cceaf5-c7f0-4c36-956d-74caa8c5b190]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:15:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:57 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f Jul 07 08:15:57 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:58 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f" returned: 0 in 0.925s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:58 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f Jul 07 08:15:58 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:15:59 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Jul 07 08:15:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f" returned: 1 in 1.039s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:15:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f 2G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:15:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f 2G" returned: 0 in 0.093s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:15:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.122s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:15:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d927e8fe-153a-4497-9ea4-fd1dbba08756 tempest-VolumesExtendTest-58136998 None] Extend volume completed successfully. Jul 07 08:16:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Acquiring lock "cinder-e471ef12-4065-40e0-a64a-420b9d09839f-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Lock "cinder-e471ef12-4065-40e0-a64a-420b9d09839f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Acquiring lock "cinder-quobyte-e471ef12-4065-40e0-a64a-420b9d09839f" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Lock "cinder-quobyte-e471ef12-4065-40e0-a64a-420b9d09839f" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bd7100-ec1f-47c1-b103-aa3206dd1301]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:00 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f Jul 07 08:16:00 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:01 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f" returned: 0 in 1.140s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:01 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f Jul 07 08:16:01 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:02 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f" returned: 1 in 0.988s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:16:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:02 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f Jul 07 08:16:02 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:03 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e471ef12-4065-40e0-a64a-420b9d09839f" returned: 0 in 0.696s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Lock "cinder-quobyte-e471ef12-4065-40e0-a64a-420b9d09839f" released by "delete_volume" :: held 2.949s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:03 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Created reservations ['c275a311-64d3-4593-88c4-830902dc46f4', 'a9e544e2-bd2b-4a3d-9427-1dab6a5e72f1', '96c6f365-2fdf-4699-96d9-cb5be406a37f', '830e9622-5e3e-43d7-bc34-c8480e29bfb2'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:03 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:16:03 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Flow 'volume_create_manager' (7698e114-51ec-46c2-9428-8e6f0a9ec844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e9cf43-ade1-4d26-8758-9e67aadb3deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:04 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:16:04 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e9cf43-ade1-4d26-8758-9e67aadb3deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-45359635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f808cd46-92bf-4e39-b580-574e0bf70d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3899f339f0fd4dc6896c6b7c41c5d70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:05Z,use_quota=True,user_id='f60cda450d4e4ed3ac707ece9e116ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:04 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc1d82a-5950-4ffb-892c-c9c21e786a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc1d82a-5950-4ffb-892c-c9c21e786a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a34183-c7dc-47be-a141-2c2ea6ca0afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a34183-c7dc-47be-a141-2c2ea6ca0afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f808cd46-92bf-4e39-b580-574e0bf70d59', 'volume_name': 'volume-f808cd46-92bf-4e39-b580-574e0bf70d59', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77e1ca5-50a9-4ac0-81de-c544d6490da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77e1ca5-50a9-4ac0-81de-c544d6490da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10805b45-993b-4074-861f-00fcab1a6fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:04 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Volume f808cd46-92bf-4e39-b580-574e0bf70d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f808cd46-92bf-4e39-b580-574e0bf70d59', 'volume_size': 1} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-45359635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f808cd46-92bf-4e39-b580-574e0bf70d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3899f339f0fd4dc6896c6b7c41c5d70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:05Z,use_quota=True,user_id='f60cda450d4e4ed3ac707ece9e116ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Creating volume f808cd46-92bf-4e39-b580-574e0bf70d59 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:16:04 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.178s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:16:04 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Deleted volume successfully. Jul 07 08:16:04 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 1073741824 Jul 07 08:16:04 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d110b557-2cae-48e5-a491-4ba574a87bf4 tempest-VolumesExtendTest-58136998 None] Lock "cinder-e471ef12-4065-40e0-a64a-420b9d09839f-delete_volume" released by "delete_volume" :: held 4.494s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:05 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.048s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:16:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:16:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:16:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:16:05 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 1073741824" returned: 0 in 1.128s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:05 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 Jul 07 08:16:05 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:06 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59" returned: 0 in 0.869s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:16:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10805b45-993b-4074-861f-00fcab1a6fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f808cd46-92bf-4e39-b580-574e0bf70d59', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7deac263-542c-44a6-b018-a2b0bf7f3896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:06 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Volume volume-f808cd46-92bf-4e39-b580-574e0bf70d59 (f808cd46-92bf-4e39-b580-574e0bf70d59): created successfully Jul 07 08:16:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7deac263-542c-44a6-b018-a2b0bf7f3896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Flow 'volume_create_manager' (7698e114-51ec-46c2-9428-8e6f0a9ec844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e93b2e95-267d-4381-a72c-f34f8f2f2760 tempest-VolumesExtendTest-58136998 None] Created volume successfully. Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Flow 'volume_create_manager' (06000ce1-e057-4f17-8781-b5cf09ea2e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9056c307-20e7-467b-a654-6ef7a04e66d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9056c307-20e7-467b-a654-6ef7a04e66d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-448270614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70631ba7-62a1-4977-b86f-62e09e830989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2943a5cdf94777afa75df26e519328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:08Z,use_quota=True,user_id='47ce64c4345d47c78f7336516ed5c172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6ad3eb-c940-4d62-b713-5fe83ad4c545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6ad3eb-c940-4d62-b713-5fe83ad4c545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c14066f-9077-4869-b1fc-5bb71819025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c14066f-9077-4869-b1fc-5bb71819025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70631ba7-62a1-4977-b86f-62e09e830989', 'volume_name': 'volume-70631ba7-62a1-4977-b86f-62e09e830989', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439febc9-81fc-4cd7-9f20-e4970450b531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439febc9-81fc-4cd7-9f20-e4970450b531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5719751b-8220-4fc2-a4a2-5f24540df554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:08 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Volume 70631ba7-62a1-4977-b86f-62e09e830989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70631ba7-62a1-4977-b86f-62e09e830989', 'volume_size': 1} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-448270614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70631ba7-62a1-4977-b86f-62e09e830989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2943a5cdf94777afa75df26e519328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:08Z,use_quota=True,user_id='47ce64c4345d47c78f7336516ed5c172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Creating volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:16:08 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:08 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 1073741824 Jul 07 08:16:08 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:09 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 1073741824" returned: 0 in 1.037s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:09 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 Jul 07 08:16:09 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:10 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989" returned: 0 in 0.787s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.863s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Creating offline snapshot b7444e94-b3fb-463f-b92c-02d3d989eb4a of volume f808cd46-92bf-4e39-b580-574e0bf70d59 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5719751b-8220-4fc2-a4a2-5f24540df554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70631ba7-62a1-4977-b86f-62e09e830989', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79009200-51c8-4939-8e8d-6225dee6682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5ec6f3-42fa-4d0a-8ee9-b83669503d14]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:10 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Volume volume-70631ba7-62a1-4977-b86f-62e09e830989 (70631ba7-62a1-4977-b86f-62e09e830989): created successfully Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79009200-51c8-4939-8e8d-6225dee6682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Flow 'volume_create_manager' (06000ce1-e057-4f17-8781-b5cf09ea2e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-131f6ff2-bd97-44e4-88aa-4f471a9599dc tempest-SnapshotsActionsTest-671541601 None] Created volume successfully. Jul 07 08:16:10 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 Jul 07 08:16:10 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:11 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59" returned: 0 in 1.044s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:11 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a 1G Jul 07 08:16:11 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:12 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a 1G" returned: 0 in 1.123s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f808cd46-92bf-4e39-b580-574e0bf70d59 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:12 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f808cd46-92bf-4e39-b580-574e0bf70d59 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a Jul 07 08:16:12 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:13 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f808cd46-92bf-4e39-b580-574e0bf70d59 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a" returned: 0 in 0.937s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:13 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a is being set with open permissions: ugo+rw Jul 07 08:16:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:13 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a Jul 07 08:16:13 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:14 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a" returned: 0 in 0.756s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:14 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.info Jul 07 08:16:14 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:14 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.info" returned: 0 in 0.778s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:14 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.info is being set with open permissions: ugo+rw Jul 07 08:16:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:14 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.info Jul 07 08:16:14 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:15 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.info" returned: 0 in 0.795s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.562s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.168s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Creating offline snapshot 81cd4b24-5a38-4de3-a3cb-f1f051eea14a of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:16:15 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1a3a3c-9fd3-49d6-9d08-d39b641db344]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:15 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8a8c53db-447f-4b13-95b2-3c50b6033012 tempest-VolumesExtendTest-58136998 None] Create snapshot completed successfully Jul 07 08:16:15 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 Jul 07 08:16:15 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7da11676-90f4-4afe-bfc7-d48d314f6534 tempest-VolumesExtendTest-58136998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:16 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989" returned: 0 in 0.917s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:16 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a 1G Jul 07 08:16:16 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:17 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a 1G" returned: 0 in 0.959s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:17 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:16:17 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:18 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 0.794s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:18 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a is being set with open permissions: ugo+rw Jul 07 08:16:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:18 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:16:18 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:19 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 0.682s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:19 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.info Jul 07 08:16:19 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:19 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.info" returned: 0 in 0.709s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:19 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.info is being set with open permissions: ugo+rw Jul 07 08:16:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:19 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.info Jul 07 08:16:19 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:20 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.info" returned: 0 in 0.716s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.914s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7da11676-90f4-4afe-bfc7-d48d314f6534 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.056s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe50cc80-c905-4e1b-ab42-af7d55081110]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7da11676-90f4-4afe-bfc7-d48d314f6534 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:20 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1b27bc37-c95b-4eeb-ba3f-40bb96d3d181 tempest-SnapshotsActionsTest-671541601 None] Create snapshot completed successfully Jul 07 08:16:20 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 Jul 07 08:16:20 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:21 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7da11676-90f4-4afe-bfc7-d48d314f6534 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59" returned: 0 in 1.063s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7da11676-90f4-4afe-bfc7-d48d314f6534 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a 2G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7da11676-90f4-4afe-bfc7-d48d314f6534 tempest-VolumesExtendTest-58136998 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a 2G" returned: 0 in 0.237s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7da11676-90f4-4afe-bfc7-d48d314f6534 tempest-VolumesExtendTest-58136998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.359s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7da11676-90f4-4afe-bfc7-d48d314f6534 tempest-VolumesExtendTest-58136998 None] Extend volume completed successfully. Jul 07 08:16:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Creating offline snapshot db9bee0f-f83f-4f84-955c-943c05ed325b of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:16:22 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[472d2140-29dc-4a7e-aead-8d73ceb037c0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:22 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:16:22 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:23 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 1.020s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:23 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b 1G Jul 07 08:16:23 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Acquiring lock "cinder-b7444e94-b3fb-463f-b92c-02d3d989eb4a-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Lock "cinder-b7444e94-b3fb-463f-b92c-02d3d989eb4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Acquiring lock "cinder-quobyte-f808cd46-92bf-4e39-b580-574e0bf70d59" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Lock "cinder-quobyte-f808cd46-92bf-4e39-b580-574e0bf70d59" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Acquiring lock "cinder-quobyte-b7444e94-b3fb-463f-b92c-02d3d989eb4a" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Lock "cinder-quobyte-b7444e94-b3fb-463f-b92c-02d3d989eb4a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Deleting offline snapshot b7444e94-b3fb-463f-b92c-02d3d989eb4a of volume f808cd46-92bf-4e39-b580-574e0bf70d59 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] snapshot_file for this snap is: volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d64d7ea-926d-479d-a0f0-c8bf42eeb656]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:23 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a Jul 07 08:16:23 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:24 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b 1G" returned: 0 in 1.128s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:24 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a" returned: 0 in 0.982s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f808cd46-92bf-4e39-b580-574e0bf70d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:24 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b Jul 07 08:16:24 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fdec29-da8f-470f-8544-210fb61b14f0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:24 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 Jul 07 08:16:24 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:25 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b" returned: 0 in 1.012s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:25 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b is being set with open permissions: ugo+rw Jul 07 08:16:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:25 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b Jul 07 08:16:25 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:25 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59" returned: 0 in 1.172s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:25 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a Jul 07 08:16:25 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:26 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b" returned: 0 in 0.925s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:26 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=73,cinder:UPDATE=68,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:16:26 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=82,cinder:DELETE=4,cinder:SELECT=66,cinder:INSERT=23 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:16:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.216s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7caa8295-a7c2-4c44-8087-5e0dd776620c tempest-SnapshotsActionsTest-671541601 None] Create snapshot completed successfully Jul 07 08:16:27 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a" returned: 0 in 1.398s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:27 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a Jul 07 08:16:27 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-db9bee0f-f83f-4f84-955c-943c05ed325b-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-db9bee0f-f83f-4f84-955c-943c05ed325b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-quobyte-db9bee0f-f83f-4f84-955c-943c05ed325b" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-db9bee0f-f83f-4f84-955c-943c05ed325b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Deleting offline snapshot db9bee0f-f83f-4f84-955c-943c05ed325b of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:16:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] snapshot_file for this snap is: volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:16:28 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa4f82-753a-49e1-996b-3c542cd145f0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:28 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:28 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b Jul 07 08:16:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59.b7444e94-b3fb-463f-b92c-02d3d989eb4a" returned: 0 in 1.020s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:28 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:28 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Lock "cinder-quobyte-b7444e94-b3fb-463f-b92c-02d3d989eb4a" released by "_delete_snapshot" :: held 4.735s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:28 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Lock "cinder-quobyte-f808cd46-92bf-4e39-b580-574e0bf70d59" released by "delete_snapshot" :: held 4.767s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:28 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Created reservations ['b2fe181a-5c4c-4b6b-b712-8cfef2d7af17', 'ca08f871-0065-445d-ab9b-5b9be1734096', '8facaa4f-3e66-4d21-8972-b5df6946a8b2', '56e91cb9-f650-4cf3-a2d7-5a1ca59a329c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:28 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Delete snapshot completed successfully. Jul 07 08:16:28 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a9b1e53-e262-4c2a-8176-d89e48260457 tempest-VolumesExtendTest-58136998 None] Lock "cinder-b7444e94-b3fb-463f-b92c-02d3d989eb4a-delete_snapshot" released by "delete_snapshot" :: held 4.969s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:28 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Acquiring lock "cinder-f808cd46-92bf-4e39-b580-574e0bf70d59-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Lock "cinder-f808cd46-92bf-4e39-b580-574e0bf70d59-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Acquiring lock "cinder-quobyte-f808cd46-92bf-4e39-b580-574e0bf70d59" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Lock "cinder-quobyte-f808cd46-92bf-4e39-b580-574e0bf70d59" acquired by "delete_volume" :: waited 0.033s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:29 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda57d77-cf29-46a4-b5b4-73cf07c54af2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:29 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b" returned: 0 in 1.368s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:29 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 Jul 07 08:16:29 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:29 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed82e05-f7d4-4af9-843b-092fe02c79a0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:29 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:16:29 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:30 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59" returned: 0 in 1.059s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:30 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59 Jul 07 08:16:30 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:30 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 1.283s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:30 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b Jul 07 08:16:30 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:31 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f808cd46-92bf-4e39-b580-574e0bf70d59" returned: 0 in 1.043s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Lock "cinder-quobyte-f808cd46-92bf-4e39-b580-574e0bf70d59" released by "delete_volume" :: held 2.219s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:31 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Created reservations ['3f3f4040-51c9-4266-bb30-95c0aa52d283', '6211bea7-17f2-4ef1-9bcd-166ec2a5eb4a', '97423013-2377-4c29-8dee-f64dd50868ef', 'd70987a5-05fa-4f37-a38f-8bf546a20fcb'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:31 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:16:31 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:32 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b" returned: 0 in 1.346s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:32 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b Jul 07 08:16:32 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:32 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.182s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:32 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:16:32 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Deleted volume successfully. Jul 07 08:16:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df9e1c90-59bb-42fd-8d29-91620efe826f tempest-VolumesExtendTest-58136998 None] Lock "cinder-f808cd46-92bf-4e39-b580-574e0bf70d59-delete_volume" released by "delete_volume" :: held 3.792s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:33 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.db9bee0f-f83f-4f84-955c-943c05ed325b" returned: 0 in 1.195s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-db9bee0f-f83f-4f84-955c-943c05ed325b" released by "_delete_snapshot" :: held 5.357s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" released by "delete_snapshot" :: held 5.389s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:33 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Created reservations ['00fec681-cffa-4b3b-9e85-a6eb93b5a175', '8750d3a2-523f-459c-aa4f-904394faf51d', '87964fc8-ddda-44f7-b555-b3c8b42f13c2', '392c37b1-7e7d-4787-9dfc-ebeae142e495'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Delete snapshot completed successfully. Jul 07 08:16:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d99a9794-fef3-4db7-b099-e9e540e02718 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-db9bee0f-f83f-4f84-955c-943c05ed325b-delete_snapshot" released by "delete_snapshot" :: held 5.613s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Creating offline snapshot ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:16:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9678f72-f43f-4dcb-ae5f-9ac0515db024]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:35 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:16:35 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:36 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 1.151s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:36 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 1G Jul 07 08:16:36 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:37 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 1G" returned: 0 in 1.553s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:37 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 Jul 07 08:16:37 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:38 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792" returned: 0 in 0.885s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:38 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 is being set with open permissions: ugo+rw Jul 07 08:16:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:38 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 Jul 07 08:16:38 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:39 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792" returned: 0 in 0.728s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.511s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:39 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9ae1f4b9-5d23-462a-8347-63bc0c3077fa tempest-SnapshotsActionsTest-671541601 None] Create snapshot completed successfully Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-ce348e1b-0a7d-40d5-b5cf-f8f51fe94792-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-ce348e1b-0a7d-40d5-b5cf-f8f51fe94792-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-quobyte-ce348e1b-0a7d-40d5-b5cf-f8f51fe94792" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-ce348e1b-0a7d-40d5-b5cf-f8f51fe94792" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Deleting offline snapshot ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] snapshot_file for this snap is: volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d676719-3b76-40e9-8b77-a67ceeb122d7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Flow 'volume_create_manager' (b024a3a5-5e3d-4df4-8c4f-56b2bfef2aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404dc7f3-7673-4a99-adf5-57358d0a2f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:40 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 Jul 07 08:16:40 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404dc7f3-7673-4a99-adf5-57358d0a2f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1228370171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd587d4-def1-41c7-98ea-f29291bcf9d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e19f020b1dbd43c5869d8f68798f0823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:41Z,use_quota=True,user_id='4dad892790344db89544788569a5a7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d410c9-89c1-4be9-bb01-38d9e60804d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d410c9-89c1-4be9-bb01-38d9e60804d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b16d88-6d97-4c6e-b28a-1b9bed046e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b16d88-6d97-4c6e-b28a-1b9bed046e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd587d4-def1-41c7-98ea-f29291bcf9d0', 'volume_name': 'volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5b8508-c39e-450f-b46a-1490b504323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5b8508-c39e-450f-b46a-1490b504323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0485ee99-5f29-4659-8d76-20d5d0c92b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:40 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Volume 6bd587d4-def1-41c7-98ea-f29291bcf9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0', 'volume_size': 1} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1228370171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd587d4-def1-41c7-98ea-f29291bcf9d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e19f020b1dbd43c5869d8f68798f0823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:41Z,use_quota=True,user_id='4dad892790344db89544788569a5a7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Creating volume 6bd587d4-def1-41c7-98ea-f29291bcf9d0 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:16:40 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:16:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:40 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 1073741824 Jul 07 08:16:40 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:41 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792" returned: 0 in 0.844s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:41 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abe2512-c009-496b-93c0-d4b158f26a33]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:41 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:16:41 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:41 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 1073741824" returned: 0 in 1.067s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:41 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 Jul 07 08:16:41 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:42 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 1.121s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:42 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 Jul 07 08:16:42 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:42 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0" returned: 0 in 0.911s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0485ee99-5f29-4659-8d76-20d5d0c92b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd088c45-6b51-4a35-904e-b743cce43a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:42 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Volume volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 (6bd587d4-def1-41c7-98ea-f29291bcf9d0): created successfully Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd088c45-6b51-4a35-904e-b743cce43a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Flow 'volume_create_manager' (b024a3a5-5e3d-4df4-8c4f-56b2bfef2aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:42 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-114d1080-2293-46e6-a420-208725ba9ed9 tempest-VolumesListTestJSON-1638842825 None] Created volume successfully. Jul 07 08:16:43 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792" returned: 0 in 0.945s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:43 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792 Jul 07 08:16:43 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:44 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.ce348e1b-0a7d-40d5-b5cf-f8f51fe94792" returned: 0 in 0.799s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-ce348e1b-0a7d-40d5-b5cf-f8f51fe94792" released by "_delete_snapshot" :: held 3.863s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" released by "delete_snapshot" :: held 3.907s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Created reservations ['fc682e51-1d00-4a23-bfcf-795d245f61b8', 'ca6f5666-80bc-46b4-8acb-714f463349e2', 'dc889229-7702-4007-93fb-148bc4d98a4b', 'ec8ce99e-2d74-4628-af22-b1006232d568'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Flow 'volume_create_manager' (d20f32b0-4cd4-48a5-b672-74ed2b14d7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f7e0a4-7756-4311-8b72-191f45d33ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f7e0a4-7756-4311-8b72-191f45d33ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1285513192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54def5f8-0b13-4ba9-a646-aa41fbd7deae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e19f020b1dbd43c5869d8f68798f0823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:44Z,use_quota=True,user_id='4dad892790344db89544788569a5a7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6819463-9e69-4b95-9527-0dd647970544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6819463-9e69-4b95-9527-0dd647970544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944cba01-4fb1-4f4b-9a53-6c6b15b01c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944cba01-4fb1-4f4b-9a53-6c6b15b01c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54def5f8-0b13-4ba9-a646-aa41fbd7deae', 'volume_name': 'volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c596ac35-ba58-4a19-b201-6c7f59c4c169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c596ac35-ba58-4a19-b201-6c7f59c4c169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98aea6ef-4f1c-4cb4-9dcb-34ba22723d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:44 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Volume 54def5f8-0b13-4ba9-a646-aa41fbd7deae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae', 'volume_size': 1} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1285513192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54def5f8-0b13-4ba9-a646-aa41fbd7deae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e19f020b1dbd43c5869d8f68798f0823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:44Z,use_quota=True,user_id='4dad892790344db89544788569a5a7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Creating volume 54def5f8-0b13-4ba9-a646-aa41fbd7deae {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:16:44 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:44 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae 1073741824 Jul 07 08:16:44 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:44 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Delete snapshot completed successfully. Jul 07 08:16:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0d1ff5ce-7244-4c54-8eb1-de362d6f5fec tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-ce348e1b-0a7d-40d5-b5cf-f8f51fe94792-delete_snapshot" released by "delete_snapshot" :: held 4.157s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:45 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae 1073741824" returned: 0 in 0.923s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:45 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae Jul 07 08:16:45 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:46 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae" returned: 0 in 0.684s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.162s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98aea6ef-4f1c-4cb4-9dcb-34ba22723d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc288d2-2745-40ff-a508-b0c00bd7b363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Creating offline snapshot 3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:16:46 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Volume volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae (54def5f8-0b13-4ba9-a646-aa41fbd7deae): created successfully Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc288d2-2745-40ff-a508-b0c00bd7b363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Flow 'volume_create_manager' (d20f32b0-4cd4-48a5-b672-74ed2b14d7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35947e4-5011-462e-ae3c-a7a34a3432b8]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:46 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b9039e3a-a5a4-4b96-b2d3-451d2dd4e10d tempest-VolumesListTestJSON-1638842825 None] Created volume successfully. Jul 07 08:16:46 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:16:46 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Flow 'volume_create_manager' (b729cbbe-d378-414f-896c-7a1fa695a1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a04ac3-7500-4ad6-a28f-18f63c6a6dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a04ac3-7500-4ad6-a28f-18f63c6a6dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1143789229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fbcc6f-0f86-4c39-990f-28bf0474632f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e19f020b1dbd43c5869d8f68798f0823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:47Z,use_quota=True,user_id='4dad892790344db89544788569a5a7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6579be-a137-4762-914d-5cf173ae12e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:47 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6579be-a137-4762-914d-5cf173ae12e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a34936-6b56-4b49-b059-005cb2f5538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a34936-6b56-4b49-b059-005cb2f5538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11fbcc6f-0f86-4c39-990f-28bf0474632f', 'volume_name': 'volume-11fbcc6f-0f86-4c39-990f-28bf0474632f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a2727f-73c8-4dd4-89be-55ea6743be15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a2727f-73c8-4dd4-89be-55ea6743be15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487d37f4-91d9-4df9-96b5-f64b1a511d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:47 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Volume 11fbcc6f-0f86-4c39-990f-28bf0474632f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11fbcc6f-0f86-4c39-990f-28bf0474632f', 'volume_size': 1} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 0.869s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:47 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 1G Jul 07 08:16:47 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:48 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 1G" returned: 0 in 1.158s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:48 devstack sudo[91430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 Jul 07 08:16:48 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:49 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1" returned: 0 in 0.719s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:49 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 is being set with open permissions: ugo+rw Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:49 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 Jul 07 08:16:49 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:49 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1" returned: 0 in 0.743s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.646s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.684s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1143789229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fbcc6f-0f86-4c39-990f-28bf0474632f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e19f020b1dbd43c5869d8f68798f0823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:47Z,use_quota=True,user_id='4dad892790344db89544788569a5a7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Creating volume 11fbcc6f-0f86-4c39-990f-28bf0474632f {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:16:49 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:16:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:49 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f 1073741824 Jul 07 08:16:49 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-618bf275-9012-44dc-9c43-c2854ed63d13 tempest-SnapshotsActionsTest-671541601 None] Create snapshot completed successfully Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-3eb0d9a0-f674-4a37-9f9b-d095f9b091f1-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-3eb0d9a0-f674-4a37-9f9b-d095f9b091f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-quobyte-3eb0d9a0-f674-4a37-9f9b-d095f9b091f1" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-3eb0d9a0-f674-4a37-9f9b-d095f9b091f1" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Deleting offline snapshot 3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] snapshot_file for this snap is: volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9abbca-927b-409b-af47-a4d4d152ec18]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:50 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 Jul 07 08:16:50 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:51 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f 1073741824" returned: 0 in 1.100s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:51 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f Jul 07 08:16:51 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:51 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1" returned: 0 in 1.151s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:51 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e8da68-a5c8-4fe0-91a3-f5298272aafb]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:51 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:16:51 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:52 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f" returned: 0 in 0.929s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.135s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487d37f4-91d9-4df9-96b5-f64b1a511d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11fbcc6f-0f86-4c39-990f-28bf0474632f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a02530b-85ed-42d8-9c5a-3024b75867bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:52 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Volume volume-11fbcc6f-0f86-4c39-990f-28bf0474632f (11fbcc6f-0f86-4c39-990f-28bf0474632f): created successfully Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a02530b-85ed-42d8-9c5a-3024b75867bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Flow 'volume_create_manager' (b729cbbe-d378-414f-896c-7a1fa695a1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2e27eaae-edd4-46a3-b3b7-5de55ee7d504 tempest-VolumesListTestJSON-1638842825 None] Created volume successfully. Jul 07 08:16:52 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 0.971s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:52 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 Jul 07 08:16:52 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:53 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1" returned: 0 in 1.152s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:54 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1 Jul 07 08:16:54 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:54 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.3eb0d9a0-f674-4a37-9f9b-d095f9b091f1" returned: 0 in 0.806s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-3eb0d9a0-f674-4a37-9f9b-d095f9b091f1" released by "_delete_snapshot" :: held 4.194s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" released by "delete_snapshot" :: held 4.244s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:54 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Created reservations ['a71ea479-9487-4e06-a492-bcb6ef41e45f', '6c530b90-5e15-4223-9273-1b124ed09c42', '293dfb12-60b2-4a65-8404-4d3b942da4b3', '42e57ac2-1c6d-4b8e-b281-393d5144cef7'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Delete snapshot completed successfully. Jul 07 08:16:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-31cc7b0e-47fe-4fa3-9f98-7814c8496c03 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-3eb0d9a0-f674-4a37-9f9b-d095f9b091f1-delete_snapshot" released by "delete_snapshot" :: held 4.454s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "cinder-11fbcc6f-0f86-4c39-990f-28bf0474632f-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-11fbcc6f-0f86-4c39-990f-28bf0474632f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "cinder-quobyte-11fbcc6f-0f86-4c39-990f-28bf0474632f" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-quobyte-11fbcc6f-0f86-4c39-990f-28bf0474632f" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:55 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f4799-25f3-414f-8849-89e67b9ca070]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:55 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f Jul 07 08:16:55 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:56 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f" returned: 0 in 0.827s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:56 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f Jul 07 08:16:56 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Creating offline snapshot abe16a4c-645b-43b0-a835-365beed60f65 of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:16:56 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffa5fd9-5ee9-4c30-b67b-4f9238922032]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:56 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:16:56 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:57 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11fbcc6f-0f86-4c39-990f-28bf0474632f" returned: 0 in 1.068s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-quobyte-11fbcc6f-0f86-4c39-990f-28bf0474632f" released by "delete_volume" :: held 1.965s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Flow 'volume_create_manager' (7c9c97ff-d237-491b-a335-c427444d2c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732e35ca-d0da-4a47-850a-d715241489b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732e35ca-d0da-4a47-850a-d715241489b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1987291161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d50f40-e45c-4461-86ea-a085d0992ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649eaaed39d94ea78e4446dd484bbdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:57Z,use_quota=True,user_id='a27fef9d52644c2e89f39e45b9f9ffef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6393dc-db1f-4db6-a965-de5838a05c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6393dc-db1f-4db6-a965-de5838a05c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68237e34-bcd0-40f4-a042-9319ed0c7d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68237e34-bcd0-40f4-a042-9319ed0c7d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d50f40-e45c-4461-86ea-a085d0992ddd', 'volume_name': 'volume-e7d50f40-e45c-4461-86ea-a085d0992ddd', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f45dcd-2c4f-45e9-9b0c-23609e6d3b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f45dcd-2c4f-45e9-9b0c-23609e6d3b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbaba2e-ad09-4541-9037-f9ca8bba3e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:16:57 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Volume e7d50f40-e45c-4461-86ea-a085d0992ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d50f40-e45c-4461-86ea-a085d0992ddd', 'volume_size': 1} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:57 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 1.143s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:57 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 1G Jul 07 08:16:57 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Created reservations ['87c8bbd1-bf68-4739-a7f4-d14500e13790', 'dc1ceab8-d801-4d3d-b0e8-2e5f2ecd6144', 'b84fc0ec-5a45-477d-9eb8-5c5000ee989d', '96fc5f40-e9e1-4505-96aa-c2a2e1022133'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:16:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:57 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:16:57 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:58 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.838s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:58 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:16:58 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Deleted volume successfully. Jul 07 08:16:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-376f0b30-d1b4-4b92-b881-c12328f52899 tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-11fbcc6f-0f86-4c39-990f-28bf0474632f-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:16:58 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 1G" returned: 0 in 1.333s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "cinder-54def5f8-0b13-4ba9-a646-aa41fbd7deae-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-54def5f8-0b13-4ba9-a646-aa41fbd7deae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:58 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 Jul 07 08:16:58 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "cinder-quobyte-54def5f8-0b13-4ba9-a646-aa41fbd7deae" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:16:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-quobyte-54def5f8-0b13-4ba9-a646-aa41fbd7deae" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:16:59 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5f0733-094c-4bee-936a-4c7052fa7f34]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:16:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:59 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae Jul 07 08:16:59 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:16:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65" returned: 0 in 0.976s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:16:59 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 is being set with open permissions: ugo+rw Jul 07 08:16:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:16:59 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Jul 07 08:16:59 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 Jul 07 08:16:59 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:00 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae" returned: 0 in 1.187s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:00 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae Jul 07 08:17:00 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:00 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65" returned: 0 in 0.847s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.427s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.232s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1987291161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d50f40-e45c-4461-86ea-a085d0992ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649eaaed39d94ea78e4446dd484bbdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:16:57Z,use_quota=True,user_id='a27fef9d52644c2e89f39e45b9f9ffef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Creating volume e7d50f40-e45c-4461-86ea-a085d0992ddd {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:00 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:17:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:00 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-33ff6a19-0f57-4069-80d1-1ea0eb39bf5d tempest-SnapshotsActionsTest-671541601 None] Create snapshot completed successfully Jul 07 08:17:00 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd 1073741824 Jul 07 08:17:00 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:01 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54def5f8-0b13-4ba9-a646-aa41fbd7deae" returned: 0 in 0.835s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-quobyte-54def5f8-0b13-4ba9-a646-aa41fbd7deae" released by "delete_volume" :: held 2.083s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Created reservations ['48713e92-be2e-425f-8d05-2b3bd76efd7c', '886dd575-4226-483b-84e5-910cc18ac9f6', '093fb061-99ad-41d7-9d37-91e68cdac253', 'b51be558-da72-4461-8474-b1808d57174b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:01 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:17:01 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "cinder-6bd587d4-def1-41c7-98ea-f29291bcf9d0-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-6bd587d4-def1-41c7-98ea-f29291bcf9d0-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "cinder-quobyte-6bd587d4-def1-41c7-98ea-f29291bcf9d0" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-quobyte-6bd587d4-def1-41c7-98ea-f29291bcf9d0" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2754d-59bb-4551-a1b7-5fe4117c3582]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-abe16a4c-645b-43b0-a835-365beed60f65-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-abe16a4c-645b-43b0-a835-365beed60f65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Acquiring lock "cinder-quobyte-abe16a4c-645b-43b0-a835-365beed60f65" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:02 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 Jul 07 08:17:02 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-abe16a4c-645b-43b0-a835-365beed60f65" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Deleting offline snapshot abe16a4c-645b-43b0-a835-365beed60f65 of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] snapshot_file for this snap is: volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2e94b8-9f38-43c2-91f4-b40ee59f1e8e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:02 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 Jul 07 08:17:02 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:02 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd 1073741824" returned: 0 in 1.634s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:02 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd Jul 07 08:17:02 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:02 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.469s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:02 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Deleted volume successfully. Jul 07 08:17:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a2680a5-0c76-4c9b-a150-fb112702a97f tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-54def5f8-0b13-4ba9-a646-aa41fbd7deae-delete_volume" released by "delete_volume" :: held 3.919s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:03 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0" returned: 0 in 1.308s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:03 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0 Jul 07 08:17:03 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:03 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65" returned: 0 in 1.288s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59daddf-32d1-4000-b37a-db4cc38f53f7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:03 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:17:03 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:03 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd" returned: 0 in 1.167s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] <== create_volume: return (2908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.912s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbaba2e-ad09-4541-9037-f9ca8bba3e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d50f40-e45c-4461-86ea-a085d0992ddd', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5452a2c3-7c2b-4a20-9ceb-468700893d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:03 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Volume volume-e7d50f40-e45c-4461-86ea-a085d0992ddd (e7d50f40-e45c-4461-86ea-a085d0992ddd): created successfully Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5452a2c3-7c2b-4a20-9ceb-468700893d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Flow 'volume_create_manager' (7c9c97ff-d237-491b-a335-c427444d2c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-92d621fb-44e5-40b6-aa04-63fd2ddcba1d tempest-ServerActionsTestOtherA-1961187204 None] Created volume successfully. Jul 07 08:17:03 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6bd587d4-def1-41c7-98ea-f29291bcf9d0" returned: 0 in 0.914s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-quobyte-6bd587d4-def1-41c7-98ea-f29291bcf9d0" released by "delete_volume" :: held 2.289s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:03 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Created reservations ['8674e4a1-2afd-4771-8c9b-44c21c91ed01', '103e1282-f32b-4f36-ae98-a3643e2bcc6c', '2673a9c8-a188-49fc-9909-c8721f932460', '94db3e27-aa09-40e6-ac0b-877d98e72c88'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:04 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:17:04 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:04 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 0.903s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:04 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 Jul 07 08:17:04 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:04 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:17:04 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:04 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.654s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:04 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Deleted volume successfully. Jul 07 08:17:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0747111-ef9b-40ee-957f-b53a0c9afcb1 tempest-VolumesListTestJSON-1638842825 None] Lock "cinder-6bd587d4-def1-41c7-98ea-f29291bcf9d0-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:05 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65" returned: 0 in 0.869s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:05 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65 Jul 07 08:17:05 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:05 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.746s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:17:05 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.abe16a4c-645b-43b0-a835-365beed60f65" returned: 0 in 0.716s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-abe16a4c-645b-43b0-a835-365beed60f65" released by "_delete_snapshot" :: held 3.923s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" released by "delete_snapshot" :: held 3.978s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Created reservations ['54c964ce-e204-48d2-9e63-e2fc91e92c25', '55add7f5-da64-4403-bca2-0f91d0fcc382', '75df7b1d-107c-4347-8234-16de7461bcb9', '783ffb60-14c9-4e7a-8bfc-c7cc105cc2fe'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Delete snapshot completed successfully. Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b5f375c8-224d-4426-ad63-7feafb378900 tempest-SnapshotsActionsTest-98014081 None] Lock "cinder-abe16a4c-645b-43b0-a835-365beed60f65-delete_snapshot" released by "delete_snapshot" :: held 4.166s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "cinder-81cd4b24-5a38-4de3-a3cb-f1f051eea14a-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-81cd4b24-5a38-4de3-a3cb-f1f051eea14a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "cinder-quobyte-81cd4b24-5a38-4de3-a3cb-f1f051eea14a" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-quobyte-81cd4b24-5a38-4de3-a3cb-f1f051eea14a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Deleting offline snapshot 81cd4b24-5a38-4de3-a3cb-f1f051eea14a of volume 70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] snapshot_file for this snap is: volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee35cbe-b4f9-437c-b75d-6a3f5ff280a2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:06 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:17:06 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:07 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 0.822s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70631ba7-62a1-4977-b86f-62e09e830989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:17:07 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[df40bc6c-f545-4c3b-8e03-47c63e728e6e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:07 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 Jul 07 08:17:07 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Flow 'volume_create_manager' (b34f920e-73d7-4670-99e8-a613a2e47854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387152c5-15a2-4e92-95b4-cee1eb6946d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387152c5-15a2-4e92-95b4-cee1eb6946d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1418788532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20e1fb3-0f81-49b0-9585-dce9a20cf14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0fdaa4acc248eb9a241d56d4fbdf02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:08Z,use_quota=True,user_id='926fde174e5847eb89edf2b989be4d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5037d25f-5db0-4e44-94d9-85039b7bb1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5037d25f-5db0-4e44-94d9-85039b7bb1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec29fbb-d1a8-49bb-894d-8991f1ab2175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec29fbb-d1a8-49bb-894d-8991f1ab2175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20e1fb3-0f81-49b0-9585-dce9a20cf14c', 'volume_name': 'volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c', 'volume_size': 2}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e734859-acc5-4cac-b242-072189cc7daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e734859-acc5-4cac-b242-072189cc7daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b044c5b1-ce5b-490e-8a9b-297da3739449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:08 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Volume c20e1fb3-0f81-49b0-9585-dce9a20cf14c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c', 'volume_size': 2} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1418788532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20e1fb3-0f81-49b0-9585-dce9a20cf14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0fdaa4acc248eb9a241d56d4fbdf02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:08Z,use_quota=True,user_id='926fde174e5847eb89edf2b989be4d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Creating volume c20e1fb3-0f81-49b0-9585-dce9a20cf14c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:08 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c 2147483648 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:08 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c 2147483648 Jul 07 08:17:08 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:08 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989" returned: 0 in 0.852s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:08 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:17:08 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:09 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c 2147483648" returned: 0 in 1.100s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:09 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 0.937s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:09 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a Jul 07 08:17:09 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:09 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c Jul 07 08:17:09 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:10 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" returned: 0 in 0.822s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:10 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b044c5b1-ce5b-490e-8a9b-297da3739449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c', 'volume_size': 2}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada0cb16-e2ac-4103-9b89-0946f4c40f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989.81cd4b24-5a38-4de3-a3cb-f1f051eea14a" returned: 0 in 0.925s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:10 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Volume volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c (c20e1fb3-0f81-49b0-9585-dce9a20cf14c): created successfully Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada0cb16-e2ac-4103-9b89-0946f4c40f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Flow 'volume_create_manager' (b34f920e-73d7-4670-99e8-a613a2e47854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-quobyte-81cd4b24-5a38-4de3-a3cb-f1f051eea14a" released by "_delete_snapshot" :: held 3.693s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-bd5dd943-4ae5-4fc1-969a-33dae375628b tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Created volume successfully. Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" released by "delete_snapshot" :: held 3.723s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Created reservations ['1567937d-991a-4c06-bd14-69fa8e2dee8e', 'fa9cfa4e-658f-45ef-a69f-2733b7f670af', '8616fa91-974f-4ce1-8c07-17e1c0d8a839', '1e417e83-c03e-4f98-a27b-4a2d6a5496e1'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Delete snapshot completed successfully. Jul 07 08:17:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7a66c706-4d88-4931-8d83-31b15de9ba89 tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-81cd4b24-5a38-4de3-a3cb-f1f051eea14a-delete_snapshot" released by "delete_snapshot" :: held 3.876s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "cinder-70631ba7-62a1-4977-b86f-62e09e830989-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-70631ba7-62a1-4977-b86f-62e09e830989-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[882d13d0-73a8-47a3-9b99-b73fdcc02ee7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:11 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 Jul 07 08:17:11 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Creating offline snapshot f3c05d8b-8f21-49b8-87e9-429634be030a of volume c20e1fb3-0f81-49b0-9585-dce9a20cf14c {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca7745-839e-4a1f-bfa5-517a42a5cbad]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:11 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c Jul 07 08:17:11 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:12 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989" returned: 0 in 0.884s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:12 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989 Jul 07 08:17:12 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:12 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" returned: 0 in 0.845s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a 2G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:12 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a 2G Jul 07 08:17:12 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:12 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-70631ba7-62a1-4977-b86f-62e09e830989" returned: 0 in 0.657s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-quobyte-70631ba7-62a1-4977-b86f-62e09e830989" released by "delete_volume" :: held 1.604s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Created reservations ['43f1d6d3-e8b3-41b0-b418-e1cc2ccbdcbc', '155a4c2a-e650-424e-abdf-51b16fff3235', '24fe907a-82b1-4ec9-b0cd-3c6f7886d58b', '1e6d0cfd-4844-412a-b62e-ff0e05f3d079'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:12 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:17:12 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:13 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a 2G" returned: 0 in 0.863s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:13 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a Jul 07 08:17:13 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:13 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.812s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:13 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Deleted volume successfully. Jul 07 08:17:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9439cf17-146f-4ad0-b401-71b13889188f tempest-SnapshotsActionsTest-671541601 None] Lock "cinder-70631ba7-62a1-4977-b86f-62e09e830989-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Flow 'volume_create_manager' (89b21639-075a-4ecb-baa1-5b4af4359404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc48320c-beba-439e-9b45-7f466e430d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:14 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a" returned: 0 in 1.401s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:14 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a is being set with open permissions: ugo+rw Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc48320c-beba-439e-9b45-7f466e430d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1042683412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fc2ed9-aff0-4024-b58b-0df55244d600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4bde109a148a28951a0552661ab30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:15Z,use_quota=True,user_id='432724a9b08e4c2bbc56d55342052387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f494c3-a79e-4e22-85c0-6d547d06fe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:14 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a Jul 07 08:17:14 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f494c3-a79e-4e22-85c0-6d547d06fe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e9d8cc-ae0d-498a-9d61-b6d1beaa1224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e9d8cc-ae0d-498a-9d61-b6d1beaa1224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77fc2ed9-aff0-4024-b58b-0df55244d600', 'volume_name': 'volume-77fc2ed9-aff0-4024-b58b-0df55244d600', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f8f8ae-1189-44c2-9ead-aefd0e7e667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f8f8ae-1189-44c2-9ead-aefd0e7e667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf1560f-bc9e-4b19-ab36-d451f1f0d5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:14 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Volume 77fc2ed9-aff0-4024-b58b-0df55244d600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77fc2ed9-aff0-4024-b58b-0df55244d600', 'volume_size': 1} Jul 07 08:17:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:15 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a" returned: 0 in 0.698s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:15 devstack sudo[91778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.info Jul 07 08:17:15 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:16 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.info" returned: 0 in 0.859s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:16 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.info is being set with open permissions: ugo+rw Jul 07 08:17:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:16 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.info Jul 07 08:17:16 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:17 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.info" returned: 0 in 0.804s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.622s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.397s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1042683412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fc2ed9-aff0-4024-b58b-0df55244d600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4bde109a148a28951a0552661ab30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:15Z,use_quota=True,user_id='432724a9b08e4c2bbc56d55342052387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Creating volume 77fc2ed9-aff0-4024-b58b-0df55244d600 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:17 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:17:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:17 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 1073741824 Jul 07 08:17:17 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:17 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-89ae138a-c6fa-4114-bda7-f96a93d65c8c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Create snapshot completed successfully Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Acquiring lock "cinder-f3c05d8b-8f21-49b8-87e9-429634be030a-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-f3c05d8b-8f21-49b8-87e9-429634be030a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Acquiring lock "cinder-quobyte-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-quobyte-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Acquiring lock "cinder-quobyte-f3c05d8b-8f21-49b8-87e9-429634be030a" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-quobyte-f3c05d8b-8f21-49b8-87e9-429634be030a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Deleting offline snapshot f3c05d8b-8f21-49b8-87e9-429634be030a of volume c20e1fb3-0f81-49b0-9585-dce9a20cf14c {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] snapshot_file for this snap is: volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6cfcc2-51c3-46a6-8383-3425f0898087]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:18 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 1073741824" returned: 0 in 1.129s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:18 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a Jul 07 08:17:18 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:18 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 Jul 07 08:17:18 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:19 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600" returned: 0 in 1.019s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf1560f-bc9e-4b19-ab36-d451f1f0d5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77fc2ed9-aff0-4024-b58b-0df55244d600', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d134c7-af2f-4949-b334-a054ef5368b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:19 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a" returned: 0 in 1.287s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:17:19 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Volume volume-77fc2ed9-aff0-4024-b58b-0df55244d600 (77fc2ed9-aff0-4024-b58b-0df55244d600): created successfully Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d134c7-af2f-4949-b334-a054ef5368b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Flow 'volume_create_manager' (89b21639-075a-4ecb-baa1-5b4af4359404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b4aea6-8982-49fd-8a4f-df98f8f38649]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:19 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d4826fb9-2f84-47a0-9e98-337dbb29acd8 tempest-AttachVolumeTestJSON-1912319260 None] Created volume successfully. Jul 07 08:17:19 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c Jul 07 08:17:19 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:20 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" returned: 0 in 1.081s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:20 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a Jul 07 08:17:20 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:21 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a" returned: 0 in 0.988s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:21 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a Jul 07 08:17:21 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:22 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c.f3c05d8b-8f21-49b8-87e9-429634be030a" returned: 0 in 0.832s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-quobyte-f3c05d8b-8f21-49b8-87e9-429634be030a" released by "_delete_snapshot" :: held 4.387s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-quobyte-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" released by "delete_snapshot" :: held 4.435s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:22 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Created reservations ['5f1ae970-c498-4314-a79f-f8297e0d855c', '2d9d754e-4dc5-4f5a-b86a-ee2493017183', '55dc8239-3dde-4ded-b947-f91407bd3477', '393b0009-08d4-4f50-92e2-fdee4b0c30ef'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Delete snapshot completed successfully. Jul 07 08:17:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3cc3ca3f-6040-43e1-a000-6c67f4d4950c tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-f3c05d8b-8f21-49b8-87e9-429634be030a-delete_snapshot" released by "delete_snapshot" :: held 4.663s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-7ec78715-6d56-4d5a-9ef3-5560ee6e437f req-8ac37a40-cf75-470c-a4c8-26ec7d2b910f tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-7ec78715-6d56-4d5a-9ef3-5560ee6e437f req-8ac37a40-cf75-470c-a4c8-26ec7d2b910f tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b92244-eaa1-4b95-b3ec-f1ad9f3ae8f7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-7ec78715-6d56-4d5a-9ef3-5560ee6e437f req-8ac37a40-cf75-470c-a4c8-26ec7d2b910f tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Acquiring lock "cinder-c20e1fb3-0f81-49b0-9585-dce9a20cf14c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-c20e1fb3-0f81-49b0-9585-dce9a20cf14c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Acquiring lock "cinder-quobyte-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-quobyte-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:23 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 Jul 07 08:17:23 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f9a512-5cc9-4969-839a-d257ccd4144b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:23 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c Jul 07 08:17:23 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:24 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-7ec78715-6d56-4d5a-9ef3-5560ee6e437f req-8ac37a40-cf75-470c-a4c8-26ec7d2b910f tempest-AttachVolumeTestJSON-1912319260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600" returned: 0 in 0.827s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-7ec78715-6d56-4d5a-9ef3-5560ee6e437f req-8ac37a40-cf75-470c-a4c8-26ec7d2b910f tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-7ec78715-6d56-4d5a-9ef3-5560ee6e437f req-8ac37a40-cf75-470c-a4c8-26ec7d2b910f tempest-AttachVolumeTestJSON-1912319260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-77fc2ed9-aff0-4024-b58b-0df55244d600', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd23585ed-9870-400c-84a2-57a761209488', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:17:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-7ec78715-6d56-4d5a-9ef3-5560ee6e437f req-8ac37a40-cf75-470c-a4c8-26ec7d2b910f tempest-AttachVolumeTestJSON-1912319260 None] attachment_update completed successfully. Jul 07 08:17:24 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" returned: 0 in 0.906s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:24 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c Jul 07 08:17:24 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:25 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" returned: 0 in 0.775s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-quobyte-c20e1fb3-0f81-49b0-9585-dce9a20cf14c" released by "delete_volume" :: held 1.755s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:25 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Created reservations ['280152cb-6f6e-4732-93e4-e4cd02162b8d', '24936aaa-85d2-4a1f-a515-2605cf2c1fde', 'b923a150-5a5a-4b17-be38-c4a216bf9c4c', '7f02ef86-8b6e-40ab-bc4a-55473f28e6d9'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:25 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:17:25 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:26 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.242s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:26 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Deleted volume successfully. Jul 07 08:17:26 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=94,cinder:UPDATE=105,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:17:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4c3a1b6-5e25-4db6-ac8d-da3814e8129f tempest-VolumesSnapshotNegativeTestJSON-1853478344 None] Lock "cinder-c20e1fb3-0f81-49b0-9585-dce9a20cf14c-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:27 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:DELETE=8,cinder:SELECT=93,cinder:INSERT=32,cinder:UPDATE=118 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:17:37 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Flow 'volume_create_manager' (b20b8e72-4703-4fdc-aba3-6b3ad78872a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45e9764-9e43-48e6-a693-ec5e0e64a57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45e9764-9e43-48e6-a693-ec5e0e64a57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1174853406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36510115-d982-4388-90f0-c3b164e54318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3411b1188f34c59a1486bb35108a0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:41Z,use_quota=True,user_id='194844d185e34667bbe1b8aec75ae4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f2172a-7a80-4a15-9182-b44265766733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f2172a-7a80-4a15-9182-b44265766733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374f7c34-eea2-46eb-a4a8-2229ef5bb3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374f7c34-eea2-46eb-a4a8-2229ef5bb3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36510115-d982-4388-90f0-c3b164e54318', 'volume_name': 'volume-36510115-d982-4388-90f0-c3b164e54318', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f53e199-0a5d-4a5f-b9f0-dbb36ebc8030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f53e199-0a5d-4a5f-b9f0-dbb36ebc8030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18b38d4-0198-4bf4-8fce-1fae496fbd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:41 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Volume 36510115-d982-4388-90f0-c3b164e54318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36510115-d982-4388-90f0-c3b164e54318', 'volume_size': 1} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1174853406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36510115-d982-4388-90f0-c3b164e54318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3411b1188f34c59a1486bb35108a0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:41Z,use_quota=True,user_id='194844d185e34667bbe1b8aec75ae4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Creating volume 36510115-d982-4388-90f0-c3b164e54318 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:41 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:17:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:41 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318 1073741824 Jul 07 08:17:41 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:42 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318 1073741824" returned: 0 in 1.051s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:42 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318 Jul 07 08:17:42 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:43 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318" returned: 0 in 1.075s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18b38d4-0198-4bf4-8fce-1fae496fbd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36510115-d982-4388-90f0-c3b164e54318', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9cab02-9e26-4812-9dc7-62ad683a2f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:43 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Volume volume-36510115-d982-4388-90f0-c3b164e54318 (36510115-d982-4388-90f0-c3b164e54318): created successfully Jul 07 08:17:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9cab02-9e26-4812-9dc7-62ad683a2f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Flow 'volume_create_manager' (b20b8e72-4703-4fdc-aba3-6b3ad78872a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ce5b0ec4-d2d7-4bf4-a12c-2746f4f0c35c tempest-VolumeQuotasAdminTestJSON-183370036 None] Created volume successfully. Jul 07 08:17:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Acquiring lock "cinder-36510115-d982-4388-90f0-c3b164e54318-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "cinder-36510115-d982-4388-90f0-c3b164e54318-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Acquiring lock "cinder-quobyte-36510115-d982-4388-90f0-c3b164e54318" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "cinder-quobyte-36510115-d982-4388-90f0-c3b164e54318" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d47f1e-9cfc-43e7-9972-a174743fc312]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:45 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318 Jul 07 08:17:45 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-69ab8950-e3d6-463d-8cd4-924d85261e89 req-1a53c2c9-a960-4d2e-a9fe-240cc5373514 tempest-ServerActionsTestOtherA-1961187204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-69ab8950-e3d6-463d-8cd4-924d85261e89 req-1a53c2c9-a960-4d2e-a9fe-240cc5373514 tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7a7b68-c493-4bf3-88d7-6cc507a1a6ea]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-69ab8950-e3d6-463d-8cd4-924d85261e89 req-1a53c2c9-a960-4d2e-a9fe-240cc5373514 tempest-ServerActionsTestOtherA-1961187204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:46 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318" returned: 0 in 1.153s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:46 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318 Jul 07 08:17:46 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:46 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd Jul 07 08:17:46 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:47 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-69ab8950-e3d6-463d-8cd4-924d85261e89 req-1a53c2c9-a960-4d2e-a9fe-240cc5373514 tempest-ServerActionsTestOtherA-1961187204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd" returned: 0 in 1.141s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-69ab8950-e3d6-463d-8cd4-924d85261e89 req-1a53c2c9-a960-4d2e-a9fe-240cc5373514 tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.174s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-69ab8950-e3d6-463d-8cd4-924d85261e89 req-1a53c2c9-a960-4d2e-a9fe-240cc5373514 tempest-ServerActionsTestOtherA-1961187204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-e7d50f40-e45c-4461-86ea-a085d0992ddd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0faa0406-cab7-49ff-8618-8a8dc9dd878d', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:17:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-69ab8950-e3d6-463d-8cd4-924d85261e89 req-1a53c2c9-a960-4d2e-a9fe-240cc5373514 tempest-ServerActionsTestOtherA-1961187204 None] attachment_update completed successfully. Jul 07 08:17:47 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-36510115-d982-4388-90f0-c3b164e54318" returned: 0 in 1.348s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "cinder-quobyte-36510115-d982-4388-90f0-c3b164e54318" released by "delete_volume" :: held 2.571s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Created reservations ['22965ce4-24e7-42cd-a62b-090820c3dd36', '39d27b57-bea4-482a-b647-fe5318083477', 'cbe3498c-720a-4661-8974-b2c021d48cd1', '0818bf33-1f95-4c7a-bbea-a9b084ee034b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:47 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:17:47 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:48 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.950s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:48 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:48 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Deleted volume successfully. Jul 07 08:17:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-deb79002-872f-4d45-a01e-174570844a76 tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "cinder-36510115-d982-4388-90f0-c3b164e54318-delete_volume" released by "delete_volume" :: held 3.803s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Flow 'volume_create_manager' (a4b4c211-9f37-4870-b1ec-9769940e4164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5e7cf9-fc8f-406a-86fc-cfd06c74a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5e7cf9-fc8f-406a-86fc-cfd06c74a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1372797821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5188aee4-81a3-4c13-aa32-cc433e4369fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3411b1188f34c59a1486bb35108a0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:49Z,use_quota=True,user_id='194844d185e34667bbe1b8aec75ae4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be1e425-07d6-49ca-b3fe-e2d7136a057f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be1e425-07d6-49ca-b3fe-e2d7136a057f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d671d2-b262-4328-976a-a08322407759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d671d2-b262-4328-976a-a08322407759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5188aee4-81a3-4c13-aa32-cc433e4369fc', 'volume_name': 'volume-5188aee4-81a3-4c13-aa32-cc433e4369fc', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e083ebe-533a-454c-b7a6-70001b197ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e083ebe-533a-454c-b7a6-70001b197ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fff65d-419f-4ce2-8395-856a6521129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:49 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Volume 5188aee4-81a3-4c13-aa32-cc433e4369fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5188aee4-81a3-4c13-aa32-cc433e4369fc', 'volume_size': 1} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1372797821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5188aee4-81a3-4c13-aa32-cc433e4369fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3411b1188f34c59a1486bb35108a0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:49Z,use_quota=True,user_id='194844d185e34667bbe1b8aec75ae4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Creating volume 5188aee4-81a3-4c13-aa32-cc433e4369fc {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:49 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:17:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:49 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc 1073741824 Jul 07 08:17:49 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:50 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc 1073741824" returned: 0 in 1.239s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:50 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc Jul 07 08:17:50 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:51 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc" returned: 0 in 1.008s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fff65d-419f-4ce2-8395-856a6521129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5188aee4-81a3-4c13-aa32-cc433e4369fc', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbfba14-e3a3-4846-9a52-5303a000809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:51 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Volume volume-5188aee4-81a3-4c13-aa32-cc433e4369fc (5188aee4-81a3-4c13-aa32-cc433e4369fc): created successfully Jul 07 08:17:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbfba14-e3a3-4846-9a52-5303a000809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Flow 'volume_create_manager' (a4b4c211-9f37-4870-b1ec-9769940e4164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ecd74fa1-c449-4128-8562-a9085168d06f tempest-VolumeQuotasAdminTestJSON-183370036 None] Created volume successfully. Jul 07 08:17:53 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-07a0368f-5e32-40aa-9a72-f32302c2b49c tempest-VolumeQuotasAdminTestJSON-706958302 None] Transfer volume completed successfully. Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Flow 'volume_create_manager' (21f11479-f83c-4836-b20a-6c79756b66b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14305231-b915-4de3-aeac-718666c4c5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14305231-b915-4de3-aeac-718666c4c5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-866162211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d93745-3ca8-4757-8776-2ba3c4b0aa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc965725ece94a9bb531119092051956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:54Z,use_quota=True,user_id='2d629c6a021d4bebb82d2d05d02f11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0ce9a3-38e1-4d54-9957-95982ad4b22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0ce9a3-38e1-4d54-9957-95982ad4b22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43acb61-8962-40f4-a2b7-b710dea99714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43acb61-8962-40f4-a2b7-b710dea99714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d93745-3ca8-4757-8776-2ba3c4b0aa4c', 'volume_name': 'volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b0117d-9dd1-49ab-b3c6-dc98ea260bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b0117d-9dd1-49ab-b3c6-dc98ea260bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7790e44f-b0db-4aee-a08f-97184bfd1fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:54 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Volume a2d93745-3ca8-4757-8776-2ba3c4b0aa4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c', 'volume_size': 1} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-866162211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d93745-3ca8-4757-8776-2ba3c4b0aa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc965725ece94a9bb531119092051956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:54Z,use_quota=True,user_id='2d629c6a021d4bebb82d2d05d02f11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Creating volume a2d93745-3ca8-4757-8776-2ba3c4b0aa4c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:54 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:54 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c 1073741824 Jul 07 08:17:54 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Acquiring lock "cinder-5188aee4-81a3-4c13-aa32-cc433e4369fc-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Lock "cinder-5188aee4-81a3-4c13-aa32-cc433e4369fc-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Acquiring lock "cinder-quobyte-5188aee4-81a3-4c13-aa32-cc433e4369fc" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Lock "cinder-quobyte-5188aee4-81a3-4c13-aa32-cc433e4369fc" acquired by "delete_volume" :: waited 0.071s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7a055c-2458-4202-9bf5-9315575d9baf]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Flow 'volume_create_manager' (2102632e-57d5-4e0a-93c8-37df700c06f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:55 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc Jul 07 08:17:55 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f0374a-9c27-452e-a5ca-3736fd550ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f0374a-9c27-452e-a5ca-3736fd550ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-521304041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb65183-d046-4578-ab30-87d56bcbefae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc965725ece94a9bb531119092051956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:55Z,use_quota=True,user_id='2d629c6a021d4bebb82d2d05d02f11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a611b5-313e-44f1-8827-0e0cdb97bf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a611b5-313e-44f1-8827-0e0cdb97bf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343d53cf-c584-40af-b7e3-ca154b31ae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343d53cf-c584-40af-b7e3-ca154b31ae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb65183-d046-4578-ab30-87d56bcbefae', 'volume_name': 'volume-6eb65183-d046-4578-ab30-87d56bcbefae', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d85fe35-c5d5-415b-9d00-a9eadb79352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d85fe35-c5d5-415b-9d00-a9eadb79352e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cae32cf-d16c-4ac4-bfb2-fbed49d4b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:55 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Volume 6eb65183-d046-4578-ab30-87d56bcbefae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb65183-d046-4578-ab30-87d56bcbefae', 'volume_size': 1} Jul 07 08:17:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:56 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c 1073741824" returned: 0 in 1.745s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:56 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c Jul 07 08:17:56 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:56 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc" returned: 0 in 1.464s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:56 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc Jul 07 08:17:56 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:57 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c" returned: 0 in 1.016s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] <== create_volume: return (2855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.858s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-521304041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb65183-d046-4578-ab30-87d56bcbefae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc965725ece94a9bb531119092051956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:17:55Z,use_quota=True,user_id='2d629c6a021d4bebb82d2d05d02f11de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Creating volume 6eb65183-d046-4578-ab30-87d56bcbefae {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:17:57 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7790e44f-b0db-4aee-a08f-97184bfd1fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:57 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae 1073741824 Jul 07 08:17:57 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb38d9b-cd15-499c-8f69-0f868d069f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:57 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Volume volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c (a2d93745-3ca8-4757-8776-2ba3c4b0aa4c): created successfully Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb38d9b-cd15-499c-8f69-0f868d069f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Flow 'volume_create_manager' (21f11479-f83c-4836-b20a-6c79756b66b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-db8a4d4a-9bb4-410a-9c63-2153aa826925 tempest-TestServerVolumeAttachmentScenario-676011362 None] Created volume successfully. Jul 07 08:17:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-a63860e8-0182-4e2e-b650-ab2657ae6f99 req-00ba8979-36e5-4b85-879f-81e646fadef7 tempest-ServerActionsTestOtherA-1961187204 None] Terminate volume connection completed successfully. Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-a63860e8-0182-4e2e-b650-ab2657ae6f99 req-00ba8979-36e5-4b85-879f-81e646fadef7 tempest-ServerActionsTestOtherA-1961187204 None] Deleting attachment 0faa0406-cab7-49ff-8618-8a8dc9dd878d. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:17:57 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5188aee4-81a3-4c13-aa32-cc433e4369fc" returned: 0 in 1.290s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Lock "cinder-quobyte-5188aee4-81a3-4c13-aa32-cc433e4369fc" released by "delete_volume" :: held 2.846s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:58 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Created reservations ['4edef6fb-ef1f-4996-b6d5-86e599bbb992', 'c7417b57-8b4f-43df-b6ec-96801c12620c', '729f8302-7063-45b4-9cbb-bb53a5b07b3f', 'ad3e4a99-580f-4344-b7ec-738886360c03'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:17:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:17:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:17:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:17:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:17:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:58 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:17:58 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:58 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae 1073741824" returned: 0 in 1.164s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:17:58 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae Jul 07 08:17:58 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:17:59 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.147s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:17:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Deleted volume successfully. Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8cb5ead3-da1d-447b-9d0e-a37fcfb22340 tempest-VolumeQuotasAdminTestJSON-716733383 None] Lock "cinder-5188aee4-81a3-4c13-aa32-cc433e4369fc-delete_volume" released by "delete_volume" :: held 4.501s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:17:59 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae" returned: 0 in 1.200s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] <== create_volume: return (2442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.446s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cae32cf-d16c-4ac4-bfb2-fbed49d4b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb65183-d046-4578-ab30-87d56bcbefae', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327660d0-7277-48a2-98de-0d622bb25c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:17:59 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Volume volume-6eb65183-d046-4578-ab30-87d56bcbefae (6eb65183-d046-4578-ab30-87d56bcbefae): created successfully Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327660d0-7277-48a2-98de-0d622bb25c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:17:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Flow 'volume_create_manager' (2102632e-57d5-4e0a-93c8-37df700c06f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:17:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-29374baf-7d61-4e35-bb27-1412564b1622 tempest-TestServerVolumeAttachmentScenario-676011362 None] Created volume successfully. Jul 07 08:18:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-a63860e8-0182-4e2e-b650-ab2657ae6f99 req-d47b26ec-422b-4a8b-b4e3-d332a7f72aa1 tempest-ServerActionsTestOtherA-1961187204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-a63860e8-0182-4e2e-b650-ab2657ae6f99 req-d47b26ec-422b-4a8b-b4e3-d332a7f72aa1 tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d441c0-680e-4b7d-a22c-82afaf362d1f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-a63860e8-0182-4e2e-b650-ab2657ae6f99 req-d47b26ec-422b-4a8b-b4e3-d332a7f72aa1 tempest-ServerActionsTestOtherA-1961187204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:00 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd Jul 07 08:18:00 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:01 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-a63860e8-0182-4e2e-b650-ab2657ae6f99 req-d47b26ec-422b-4a8b-b4e3-d332a7f72aa1 tempest-ServerActionsTestOtherA-1961187204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd" returned: 0 in 0.869s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-a63860e8-0182-4e2e-b650-ab2657ae6f99 req-d47b26ec-422b-4a8b-b4e3-d332a7f72aa1 tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.887s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-a63860e8-0182-4e2e-b650-ab2657ae6f99 req-d47b26ec-422b-4a8b-b4e3-d332a7f72aa1 tempest-ServerActionsTestOtherA-1961187204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-e7d50f40-e45c-4461-86ea-a085d0992ddd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fef263e9-8951-42a9-a0cf-6850dd0613f1', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:18:01 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-a63860e8-0182-4e2e-b650-ab2657ae6f99 req-d47b26ec-422b-4a8b-b4e3-d332a7f72aa1 tempest-ServerActionsTestOtherA-1961187204 None] attachment_update completed successfully. Jul 07 08:18:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:18:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:04 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:18:04 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:05 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.852s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:18:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:18:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:18:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:18:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-e3155ad3-4e36-4400-a69b-a3ae5bdd5b5d req-afddd638-037c-4d36-95a4-adfd60924441 tempest-AttachVolumeTestJSON-1912319260 None] Terminate volume connection completed successfully. Jul 07 08:18:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-e3155ad3-4e36-4400-a69b-a3ae5bdd5b5d req-afddd638-037c-4d36-95a4-adfd60924441 tempest-AttachVolumeTestJSON-1912319260 None] Deleting attachment d23585ed-9870-400c-84a2-57a761209488. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Flow 'volume_create_manager' (a992e080-2102-4528-8812-6613d0ccfcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54021f02-3342-457e-89b5-040ccf6ad74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54021f02-3342-457e-89b5-040ccf6ad74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-823937304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26207fc-72e1-4f68-ad11-0ae4ebeafe04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80444f11cc248b899561e7893fb85f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:15Z,use_quota=True,user_id='4695625b67fc49a992b7e90472132078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45a3b7d-d921-49fc-bf90-e2a5e30fdba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45a3b7d-d921-49fc-bf90-e2a5e30fdba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386ad57a-1d5b-4dbe-a9a3-aedb6ff64afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.image.glance [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Creating Keystone auth plugin from conf {{(pid=87179) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386ad57a-1d5b-4dbe-a9a3-aedb6ff64afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e26207fc-72e1-4f68-ad11-0ae4ebeafe04', 'volume_name': 'volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6de255-77e2-429f-b831-5cc6376cd7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6de255-77e2-429f-b831-5cc6376cd7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59a29a2-77ee-4332-8d0a-6997e21a8670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:14 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Volume e26207fc-72e1-4f68-ad11-0ae4ebeafe04: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 08:18:14 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Trying to clone e26207fc-72e1-4f68-ad11-0ae4ebeafe04 from image d183b53e-6225-438a-8e28-29fd7f440861 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]). {{(pid=87179) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:18:15 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:18:15 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Image download 20.69 MB at 20.69 MB/s Jul 07 08:18:15 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4185eaed-8311-404f-8392-4de799c078be]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:15 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD Jul 07 08:18:15 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:16 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD" returned: 0 in 1.062s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:16 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Temporary image d183b53e-6225-438a-8e28-29fd7f440861 is fetched for user 4695625b67fc49a992b7e90472132078. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:18:16 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a0605-3252-4f3c-9305-ee3ba5520a5f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:17 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD Jul 07 08:18:17 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:17 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD" returned: 0 in 1.112s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-823937304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26207fc-72e1-4f68-ad11-0ae4ebeafe04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80444f11cc248b899561e7893fb85f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:15Z,use_quota=True,user_id='4695625b67fc49a992b7e90472132078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:18:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Creating volume e26207fc-72e1-4f68-ad11-0ae4ebeafe04 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:18:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:18:18 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:18:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:18 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 1073741824 Jul 07 08:18:18 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:19 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 1073741824" returned: 0 in 1.226s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:19 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 Jul 07 08:18:19 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:20 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" returned: 0 in 1.414s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:20 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] <== create_volume: return (2694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:18:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.698s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:20 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Attempting download of d183b53e-6225-438a-8e28-29fd7f440861 ((None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}])) to volume e26207fc-72e1-4f68-ad11-0ae4ebeafe04. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:18:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2941ad25-a0a6-4add-8866-7c2e3d5dff7b]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_5h2n088g {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:20 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_5h2n088g Jul 07 08:18:20 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:21 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_5h2n088g" returned: 0 in 0.973s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_5h2n088g {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:21 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_5h2n088g Jul 07 08:18:21 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:22 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_5h2n088g" returned: 1 in 0.845s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_5h2n088g' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:18:22 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc889848-8b2e-4b9c-9d96-fd119d1901fd]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:22 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD Jul 07 08:18:22 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:23 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD" returned: 0 in 1.305s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:23 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] d183b53e-6225-438a-8e28-29fd7f440861 was qcow2, converting to raw {{(pid=87179) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:18:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:24 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 Jul 07 08:18:24 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:26 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" returned: 0 in 2.375s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:26 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_vgqi3b8tdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:18:26 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Converted 112.00 MB image at 47.10 MB/s Jul 07 08:18:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:26 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 1G Jul 07 08:18:26 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:27 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 1G" returned: 0 in 0.794s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da5ec93-2802-4525-a92b-c678c65f3205]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:27 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 Jul 07 08:18:27 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:27 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" returned: 0 in 0.783s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:28 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 Jul 07 08:18:28 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:28 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" returned: 1 in 0.816s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Downloaded image d183b53e-6225-438a-8e28-29fd7f440861 ((None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}])) to volume e26207fc-72e1-4f68-ad11-0ae4ebeafe04 successfully. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Temporary image d183b53e-6225-438a-8e28-29fd7f440861 for user 4695625b67fc49a992b7e90472132078 is deleted. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Marking volume e26207fc-72e1-4f68-ad11-0ae4ebeafe04 as bootable. {{(pid=87179) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Copying metadata from image d183b53e-6225-438a-8e28-29fd7f440861 to e26207fc-72e1-4f68-ad11-0ae4ebeafe04. {{(pid=87179) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Creating volume glance metadata for volume e26207fc-72e1-4f68-ad11-0ae4ebeafe04 backed by image d183b53e-6225-438a-8e28-29fd7f440861 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87179) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59a29a2-77ee-4332-8d0a-6997e21a8670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f2a1d0-2df1-4c4f-87ae-2e262b12afc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:28 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Volume volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 (e26207fc-72e1-4f68-ad11-0ae4ebeafe04): created successfully Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f2a1d0-2df1-4c4f-87ae-2e262b12afc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Flow 'volume_create_manager' (a992e080-2102-4528-8812-6613d0ccfcfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:28 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9f700c14-280d-4120-a94f-73e2eb1754eb tempest-VolumesImageMetadata-612647114 None] Created volume successfully. Jul 07 08:18:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Acquiring lock "cinder-e26207fc-72e1-4f68-ad11-0ae4ebeafe04-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Lock "cinder-e26207fc-72e1-4f68-ad11-0ae4ebeafe04-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Acquiring lock "cinder-quobyte-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Lock "cinder-quobyte-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:30 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedc9701-8f43-4e40-a627-fac1d9d42f64]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:30 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 Jul 07 08:18:30 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:31 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" returned: 0 in 0.844s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:31 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 Jul 07 08:18:31 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:32 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" returned: 1 in 0.891s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:18:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:32 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04 Jul 07 08:18:32 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:33 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" returned: 0 in 0.807s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Lock "cinder-quobyte-e26207fc-72e1-4f68-ad11-0ae4ebeafe04" released by "delete_volume" :: held 2.616s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Created reservations ['adfde421-0591-4278-913b-257e74e5fbc0', '3e3cb75c-613b-492b-834e-8420ff7fedb8', 'f7ac05e4-dfba-4926-95f7-4840acca52a1', 'fc7d2e9f-0e2e-4265-96e6-4208b4a0d9a0'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:33 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:18:33 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:33 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.693s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:33 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:18:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Deleted volume successfully. Jul 07 08:18:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89eb0ad8-43f1-4909-bdf3-d11902917ce7 tempest-VolumesImageMetadata-612647114 None] Lock "cinder-e26207fc-72e1-4f68-ad11-0ae4ebeafe04-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:34 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-1467a268-6bb2-4308-9b5c-eb06a487d117 req-67b71053-44fd-44fb-93cc-b792903a5f76 tempest-ServerActionsTestOtherA-1961187204 None] Terminate volume connection completed successfully. Jul 07 08:18:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-1467a268-6bb2-4308-9b5c-eb06a487d117 req-67b71053-44fd-44fb-93cc-b792903a5f76 tempest-ServerActionsTestOtherA-1961187204 None] Deleting attachment fef263e9-8951-42a9-a0cf-6850dd0613f1. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Flow 'volume_create_manager' (25aa0425-338a-4f96-96f1-ca015c642e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda35764-015f-4043-9581-6ac56a892d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda35764-015f-4043-9581-6ac56a892d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1191598219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bc21af-bf0a-4fd7-b112-0021d87bd2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282891eeb5c443b699512a63790d69d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:37Z,use_quota=True,user_id='6caed50d9a8a40bb9797dbb106c89761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6262ef4-599a-4826-a63a-8542a8015060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6262ef4-599a-4826-a63a-8542a8015060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6d4986-0869-4492-b55c-48f22a8e2967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6d4986-0869-4492-b55c-48f22a8e2967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7bc21af-bf0a-4fd7-b112-0021d87bd2da', 'volume_name': 'volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b756f2c-1e92-4ed2-b643-42cbe72fe0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b756f2c-1e92-4ed2-b643-42cbe72fe0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a02e55-fafb-432a-853a-9577a31f6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:37 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Volume d7bc21af-bf0a-4fd7-b112-0021d87bd2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da', 'volume_size': 1} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1191598219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bc21af-bf0a-4fd7-b112-0021d87bd2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282891eeb5c443b699512a63790d69d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:37Z,use_quota=True,user_id='6caed50d9a8a40bb9797dbb106c89761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Creating volume d7bc21af-bf0a-4fd7-b112-0021d87bd2da {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:18:37 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:18:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:37 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da 1073741824 Jul 07 08:18:37 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:38 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da 1073741824" returned: 0 in 0.835s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:38 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=49,cinder:UPDATE=44,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:18:38 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=45,cinder:SELECT=48,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:18:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:38 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da Jul 07 08:18:38 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:39 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" returned: 0 in 0.849s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a02e55-fafb-432a-853a-9577a31f6da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73529bff-4816-45c2-8dcd-e8df5bc6c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:39 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Volume volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da (d7bc21af-bf0a-4fd7-b112-0021d87bd2da): created successfully Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73529bff-4816-45c2-8dcd-e8df5bc6c186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Flow 'volume_create_manager' (25aa0425-338a-4f96-96f1-ca015c642e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:39 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d0695eb1-d8a6-4df9-8484-9be8e86df625 tempest-SnapshotMetadataTestJSON-230677349 None] Created volume successfully. Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Creating offline snapshot 5a298d1a-26e4-4ed0-9c33-bf5250c78c30 of volume d7bc21af-bf0a-4fd7-b112-0021d87bd2da {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e031231d-57ef-4a76-8a67-38261dd9ed37]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:39 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da Jul 07 08:18:39 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:40 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" returned: 0 in 0.768s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:40 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 1G Jul 07 08:18:40 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:41 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 1G" returned: 0 in 0.789s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:41 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 Jul 07 08:18:41 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:41 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30" returned: 0 in 0.693s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:41 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 is being set with open permissions: ugo+rw Jul 07 08:18:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:41 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 Jul 07 08:18:41 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-67299b58-89ea-402d-8c1a-da6706d9b733 req-34dbbc5b-d692-42a2-89c4-67f1c6957619 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:42 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30" returned: 0 in 0.633s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:42 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.info Jul 07 08:18:42 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:43 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.info" returned: 0 in 0.697s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:43 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.info is being set with open permissions: ugo+rw Jul 07 08:18:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:43 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.info Jul 07 08:18:43 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:43 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.info" returned: 0 in 0.636s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.321s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-67299b58-89ea-402d-8c1a-da6706d9b733 req-34dbbc5b-d692-42a2-89c4-67f1c6957619 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.547s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:43 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[7704d51d-b57a-4406-b199-234f61909444]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-67299b58-89ea-402d-8c1a-da6706d9b733 req-34dbbc5b-d692-42a2-89c4-67f1c6957619 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:44 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-20ddf15c-3359-4565-baef-8de6506d15ef tempest-SnapshotMetadataTestJSON-230677349 None] Create snapshot completed successfully Jul 07 08:18:44 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c Jul 07 08:18:44 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Acquiring lock "cinder-e7d50f40-e45c-4461-86ea-a085d0992ddd-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Lock "cinder-e7d50f40-e45c-4461-86ea-a085d0992ddd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Acquiring lock "cinder-quobyte-e7d50f40-e45c-4461-86ea-a085d0992ddd" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Lock "cinder-quobyte-e7d50f40-e45c-4461-86ea-a085d0992ddd" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:44 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-67299b58-89ea-402d-8c1a-da6706d9b733 req-34dbbc5b-d692-42a2-89c4-67f1c6957619 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c" returned: 0 in 1.010s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-67299b58-89ea-402d-8c1a-da6706d9b733 req-34dbbc5b-d692-42a2-89c4-67f1c6957619 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.036s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df680a-5ade-4801-9ef0-2113133f2ae1]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-67299b58-89ea-402d-8c1a-da6706d9b733 req-34dbbc5b-d692-42a2-89c4-67f1c6957619 tempest-TestServerVolumeAttachmentScenario-676011362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6962c13-abb0-406e-9de0-a0bdcd6c5b9b', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:18:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-67299b58-89ea-402d-8c1a-da6706d9b733 req-34dbbc5b-d692-42a2-89c4-67f1c6957619 tempest-TestServerVolumeAttachmentScenario-676011362 None] attachment_update completed successfully. Jul 07 08:18:45 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd Jul 07 08:18:45 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Acquiring lock "cinder-5a298d1a-26e4-4ed0-9c33-bf5250c78c30-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-5a298d1a-26e4-4ed0-9c33-bf5250c78c30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Acquiring lock "cinder-quobyte-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-quobyte-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Acquiring lock "cinder-quobyte-5a298d1a-26e4-4ed0-9c33-bf5250c78c30" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-quobyte-5a298d1a-26e4-4ed0-9c33-bf5250c78c30" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Deleting offline snapshot 5a298d1a-26e4-4ed0-9c33-bf5250c78c30 of volume d7bc21af-bf0a-4fd7-b112-0021d87bd2da {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] snapshot_file for this snap is: volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baaecd0-b19e-47db-983a-3d5184377fc6]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:45 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd" returned: 0 in 0.945s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:45 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd Jul 07 08:18:45 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:46 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 Jul 07 08:18:46 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:46 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e7d50f40-e45c-4461-86ea-a085d0992ddd" returned: 0 in 0.885s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:46 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30" returned: 0 in 0.919s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Lock "cinder-quobyte-e7d50f40-e45c-4461-86ea-a085d0992ddd" released by "delete_volume" :: held 1.897s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e20f4bb-0fc2-4005-a728-ff222fbc2eed]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Created reservations ['b68dc5d6-0d17-460b-8632-445c31fedbd4', '49f030d5-8bba-4696-af32-b09cca59b796', '06c77a57-43ca-4a06-829c-fad577391630', '56ba4fc7-d0ef-4dc9-91e7-24ab1badb8f1'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:47 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da Jul 07 08:18:47 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:47 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:18:47 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:47 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.691s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:47 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:18:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Deleted volume successfully. Jul 07 08:18:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-16ad7135-9959-41bc-a4de-aa06a8005682 tempest-ServerActionsTestOtherA-1961187204 None] Lock "cinder-e7d50f40-e45c-4461-86ea-a085d0992ddd-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:47 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" returned: 0 in 0.929s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:47 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 Jul 07 08:18:47 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:48 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30" returned: 0 in 0.905s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:48 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30 Jul 07 08:18:48 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:49 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da.5a298d1a-26e4-4ed0-9c33-bf5250c78c30" returned: 0 in 0.952s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-quobyte-5a298d1a-26e4-4ed0-9c33-bf5250c78c30" released by "_delete_snapshot" :: held 3.847s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-quobyte-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" released by "delete_snapshot" :: held 3.870s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:49 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Created reservations ['5f760476-51d8-4cd8-b85f-a61432276d95', 'f12cabb1-54de-49ed-af02-86bc634de082', '20eb7995-c296-45be-afac-9fd0cb0f74df', '64198c63-b713-404d-9608-bd5d58e96b42'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Delete snapshot completed successfully. Jul 07 08:18:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-82fbaaf6-5dbf-4cf2-94d6-7a4ae054ef1d tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-5a298d1a-26e4-4ed0-9c33-bf5250c78c30-delete_snapshot" released by "delete_snapshot" :: held 4.049s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Acquiring lock "cinder-d7bc21af-bf0a-4fd7-b112-0021d87bd2da-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-d7bc21af-bf0a-4fd7-b112-0021d87bd2da-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Acquiring lock "cinder-quobyte-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:18:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-quobyte-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:18:50 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b0cbb3-9c9c-4734-801d-20a9093781f7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:50 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da Jul 07 08:18:50 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:51 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" returned: 0 in 1.010s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:51 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da Jul 07 08:18:51 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:52 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" returned: 0 in 0.735s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-quobyte-d7bc21af-bf0a-4fd7-b112-0021d87bd2da" released by "delete_volume" :: held 1.829s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Created reservations ['d70e6807-e417-4603-94fd-1770bde22c42', '52794b8d-2f7b-4568-b471-e593c1602b3c', '622e5065-0fd9-43df-80ef-2915be5ecc62', 'e6ad8c8a-329f-4339-b0a4-569d9d5f048a'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:52 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:18:52 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:52 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.713s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:18:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Deleted volume successfully. Jul 07 08:18:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2e84326b-e1e4-467d-841a-effebd591698 tempest-SnapshotMetadataTestJSON-230677349 None] Lock "cinder-d7bc21af-bf0a-4fd7-b112-0021d87bd2da-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:18:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-16aa9dd9-ffbb-4c73-9116-33767053bdcb req-18ce3791-8c37-400d-81ba-51c2f3d732bc tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-16aa9dd9-ffbb-4c73-9116-33767053bdcb req-18ce3791-8c37-400d-81ba-51c2f3d732bc tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:56 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[492b48c8-9665-4651-9810-5dd13a0efc10]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:18:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-16aa9dd9-ffbb-4c73-9116-33767053bdcb req-18ce3791-8c37-400d-81ba-51c2f3d732bc tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:56 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae Jul 07 08:18:56 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:56 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-16aa9dd9-ffbb-4c73-9116-33767053bdcb req-18ce3791-8c37-400d-81ba-51c2f3d732bc tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae" returned: 0 in 0.954s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-16aa9dd9-ffbb-4c73-9116-33767053bdcb req-18ce3791-8c37-400d-81ba-51c2f3d732bc tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.974s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-16aa9dd9-ffbb-4c73-9116-33767053bdcb req-18ce3791-8c37-400d-81ba-51c2f3d732bc tempest-TestServerVolumeAttachmentScenario-676011362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-6eb65183-d046-4578-ab30-87d56bcbefae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a60dafe2-8f4e-4c46-8a1b-086e98112f68', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:18:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-16aa9dd9-ffbb-4c73-9116-33767053bdcb req-18ce3791-8c37-400d-81ba-51c2f3d732bc tempest-TestServerVolumeAttachmentScenario-676011362 None] attachment_update completed successfully. Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Flow 'volume_create_manager' (898f1d46-b8b2-4dbb-b949-f41a5c78b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4424a9f6-fb48-4ab6-a660-2456672985be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4424a9f6-fb48-4ab6-a660-2456672985be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1018511960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609df21f-3e0f-464a-9b27-af24aae178a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ddd7c6f9ff4eddb17c4f1e6c2f4723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:57Z,use_quota=True,user_id='b3031a026f164d44bfe99a7367be5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e630960b-e378-4a43-9889-53d88012b44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e630960b-e378-4a43-9889-53d88012b44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e230d2d-c612-46dc-a0e8-bedebf5aeb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e230d2d-c612-46dc-a0e8-bedebf5aeb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609df21f-3e0f-464a-9b27-af24aae178a9', 'volume_name': 'volume-609df21f-3e0f-464a-9b27-af24aae178a9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43c2d33-cb53-41f8-8c58-3b952dab591b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43c2d33-cb53-41f8-8c58-3b952dab591b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835b2466-de3b-4670-8bae-edd737e96304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:57 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Volume 609df21f-3e0f-464a-9b27-af24aae178a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609df21f-3e0f-464a-9b27-af24aae178a9', 'volume_size': 1} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1018511960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609df21f-3e0f-464a-9b27-af24aae178a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ddd7c6f9ff4eddb17c4f1e6c2f4723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:18:57Z,use_quota=True,user_id='b3031a026f164d44bfe99a7367be5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Creating volume 609df21f-3e0f-464a-9b27-af24aae178a9 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:18:57 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:18:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:57 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9 1073741824 Jul 07 08:18:57 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:58 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9 1073741824" returned: 0 in 1.043s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:18:58 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9 Jul 07 08:18:58 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:18:59 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 07 08:18:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9" returned: 0 in 0.717s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:18:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:18:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:18:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835b2466-de3b-4670-8bae-edd737e96304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609df21f-3e0f-464a-9b27-af24aae178a9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee296b6-ca4f-4680-a194-778518fc0a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:18:59 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Volume volume-609df21f-3e0f-464a-9b27-af24aae178a9 (609df21f-3e0f-464a-9b27-af24aae178a9): created successfully Jul 07 08:18:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee296b6-ca4f-4680-a194-778518fc0a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:18:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Flow 'volume_create_manager' (898f1d46-b8b2-4dbb-b949-f41a5c78b33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:18:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-21b7d961-10d2-40a5-91a2-c7036c5a7f2a tempest-VolumesTransfersV357Test-1052869704 None] Created volume successfully. Jul 07 08:19:00 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b51e997e-fe93-45ad-9ce4-8f32d3804153 tempest-VolumesTransfersV357Test-1354638742 None] Transfer volume completed successfully. Jul 07 08:19:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Acquiring lock "cinder-609df21f-3e0f-464a-9b27-af24aae178a9-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Lock "cinder-609df21f-3e0f-464a-9b27-af24aae178a9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Acquiring lock "cinder-quobyte-609df21f-3e0f-464a-9b27-af24aae178a9" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Lock "cinder-quobyte-609df21f-3e0f-464a-9b27-af24aae178a9" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:02 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[80006817-aee9-49fb-86b7-b6b647bb290d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:02 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9 Jul 07 08:19:02 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:02 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-05757d74-69fd-4d1a-abe0-944414e0efd3 req-16779b1f-fa2c-4e15-a438-3b814bb1403f tempest-TestServerVolumeAttachmentScenario-676011362 None] Terminate volume connection completed successfully. Jul 07 08:19:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-05757d74-69fd-4d1a-abe0-944414e0efd3 req-16779b1f-fa2c-4e15-a438-3b814bb1403f tempest-TestServerVolumeAttachmentScenario-676011362 None] Deleting attachment a60dafe2-8f4e-4c46-8a1b-086e98112f68. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:19:03 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9" returned: 0 in 0.838s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:03 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9 Jul 07 08:19:03 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:03 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-609df21f-3e0f-464a-9b27-af24aae178a9" returned: 0 in 0.782s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Lock "cinder-quobyte-609df21f-3e0f-464a-9b27-af24aae178a9" released by "delete_volume" :: held 1.662s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Created reservations ['131f3ab5-10aa-4925-88e7-893534f4b5f6', 'f149f5c6-c42d-437e-8237-e49a1e64dd4d', '64a8fbc7-b095-4f21-862b-37087ea77d31', '147f7387-ce68-4cc1-87a6-cf703c19456f'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:04 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:04 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:04 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:04 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Flow 'volume_create_manager' (96fff621-8eb2-4c4c-8f3d-58ec9ccaa751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb79dd23-8368-4106-a332-1c96a04b223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb79dd23-8368-4106-a332-1c96a04b223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-356817278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc47cbb-1cbe-4dab-b382-4d0962417307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ddd7c6f9ff4eddb17c4f1e6c2f4723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:05Z,use_quota=True,user_id='b3031a026f164d44bfe99a7367be5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:05 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b51bc7-8f9f-4002-b604-624ac0c86a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b51bc7-8f9f-4002-b604-624ac0c86a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8aee81-2d0c-4009-b196-63d6102c8f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8aee81-2d0c-4009-b196-63d6102c8f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc47cbb-1cbe-4dab-b382-4d0962417307', 'volume_name': 'volume-bcc47cbb-1cbe-4dab-b382-4d0962417307', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bd745e-b002-4ee9-a977-0eb9ab9590c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bd745e-b002-4ee9-a977-0eb9ab9590c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8652a38a-9fdf-4a5c-8ca0-4022ceae621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:05 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Volume bcc47cbb-1cbe-4dab-b382-4d0962417307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc47cbb-1cbe-4dab-b382-4d0962417307', 'volume_size': 1} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-356817278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc47cbb-1cbe-4dab-b382-4d0962417307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ddd7c6f9ff4eddb17c4f1e6c2f4723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:05Z,use_quota=True,user_id='b3031a026f164d44bfe99a7367be5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Creating volume bcc47cbb-1cbe-4dab-b382-4d0962417307 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:05 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.518s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:05 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Deleted volume successfully. Jul 07 08:19:05 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 1073741824 Jul 07 08:19:05 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0ef3f1d6-182b-4089-a28e-6bd493e76719 tempest-VolumesTransfersV357Test-1302617560 None] Lock "cinder-609df21f-3e0f-464a-9b27-af24aae178a9-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:05 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.262s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:19:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:19:06 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 1073741824" returned: 0 in 1.132s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:06 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 Jul 07 08:19:06 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-2123d0de-5fc2-4413-b6d4-2a35ef7a0f6f req-d428dade-fa2a-43fb-8522-db891390729c tempest-TestServerVolumeAttachmentScenario-676011362 None] Terminate volume connection completed successfully. Jul 07 08:19:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-2123d0de-5fc2-4413-b6d4-2a35ef7a0f6f req-d428dade-fa2a-43fb-8522-db891390729c tempest-TestServerVolumeAttachmentScenario-676011362 None] Deleting attachment c6962c13-abb0-406e-9de0-a0bdcd6c5b9b. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:19:07 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307" returned: 0 in 0.770s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8652a38a-9fdf-4a5c-8ca0-4022ceae621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc47cbb-1cbe-4dab-b382-4d0962417307', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a19df6b-fac4-4248-ab99-ae4ef4dcaa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:07 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Volume volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 (bcc47cbb-1cbe-4dab-b382-4d0962417307): created successfully Jul 07 08:19:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a19df6b-fac4-4248-ab99-ae4ef4dcaa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Flow 'volume_create_manager' (96fff621-8eb2-4c4c-8f3d-58ec9ccaa751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c289659d-62e2-4ef8-9ae2-68002d3af204 tempest-VolumesTransfersV357Test-1052869704 None] Created volume successfully. Jul 07 08:19:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Acquiring lock "cinder-bcc47cbb-1cbe-4dab-b382-4d0962417307-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Lock "cinder-bcc47cbb-1cbe-4dab-b382-4d0962417307-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Acquiring lock "cinder-quobyte-bcc47cbb-1cbe-4dab-b382-4d0962417307" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Lock "cinder-quobyte-bcc47cbb-1cbe-4dab-b382-4d0962417307" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:08 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[21197a68-ddff-4891-b6f7-fcbe38ab6af6]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:09 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 Jul 07 08:19:09 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:10 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307" returned: 0 in 1.177s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:10 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307 Jul 07 08:19:10 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:10 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bcc47cbb-1cbe-4dab-b382-4d0962417307" returned: 0 in 0.839s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Lock "cinder-quobyte-bcc47cbb-1cbe-4dab-b382-4d0962417307" released by "delete_volume" :: held 2.081s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:11 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Created reservations ['6242dd62-2aa0-49a4-ad2a-16b8bf149807', 'da2bc1ee-eee5-4f3e-a602-69769e6e87bf', 'f0d143f4-ce6d-4a14-a865-57f91ab2afbc', '5a13e1d0-4a26-4acc-b681-a66d9f65dc68'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:11 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:11 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:12 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.316s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:12 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:12 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Deleted volume successfully. Jul 07 08:19:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c78f692f-7896-43fa-99c2-e4e46b114503 tempest-VolumesTransfersV357Test-1302617560 None] Lock "cinder-bcc47cbb-1cbe-4dab-b382-4d0962417307-delete_volume" released by "delete_volume" :: held 3.688s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:21 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=44,cinder:INSERT=13,cinder:UPDATE=48,cinder:DELETE=6 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:19:21 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "cinder-6eb65183-d046-4578-ab30-87d56bcbefae-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:21 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "cinder-6eb65183-d046-4578-ab30-87d56bcbefae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:21 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "cinder-quobyte-6eb65183-d046-4578-ab30-87d56bcbefae" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:21 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "cinder-quobyte-6eb65183-d046-4578-ab30-87d56bcbefae" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:21 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[490d9e9b-f03d-4eca-9694-afe3c9fda012]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:21 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:21 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae Jul 07 08:19:21 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (bd8e44ba-5d15-45f7-a975-663bdcdc025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c64bd8e-2bff-4d56-8f90-554a70587d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c64bd8e-2bff-4d56-8f90-554a70587d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502041660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d95aa5-909c-4b60-ab9e-c4969029ece6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:22Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7745165-337b-4c06-8ed9-997edaa9853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7745165-337b-4c06-8ed9-997edaa9853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52445c6f-3ccc-47e7-a64c-3d9d82d742d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52445c6f-3ccc-47e7-a64c-3d9d82d742d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d95aa5-909c-4b60-ab9e-c4969029ece6', 'volume_name': 'volume-19d95aa5-909c-4b60-ab9e-c4969029ece6', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0017c13b-5d44-4b2e-9bc5-989be6067b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0017c13b-5d44-4b2e-9bc5-989be6067b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5228bc5-9a64-4983-a70b-6992240cc712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:22 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Volume 19d95aa5-909c-4b60-ab9e-c4969029ece6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d95aa5-909c-4b60-ab9e-c4969029ece6', 'volume_size': 1} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502041660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d95aa5-909c-4b60-ab9e-c4969029ece6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:22Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Creating volume 19d95aa5-909c-4b60-ab9e-c4969029ece6 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:22 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:19:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:22 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 1073741824 Jul 07 08:19:22 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:23 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae" returned: 0 in 1.296s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:23 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae Jul 07 08:19:23 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (3c1340fc-be0c-4a85-81d4-08782cb30b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc5a6be-ca1b-41e5-b736-fc03f4739742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc5a6be-ca1b-41e5-b736-fc03f4739742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-107431352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c28fac-58cb-47a0-9c53-857116ded09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:23Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4339ed-a45d-4c36-808b-f9d756acd850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4339ed-a45d-4c36-808b-f9d756acd850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3a93f2-1178-470f-9bf9-a4ab179000aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb3a93f2-1178-470f-9bf9-a4ab179000aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c28fac-58cb-47a0-9c53-857116ded09d', 'volume_name': 'volume-80c28fac-58cb-47a0-9c53-857116ded09d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852d7e12-08a2-4e85-a569-8305b45ed303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852d7e12-08a2-4e85-a569-8305b45ed303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86ed490-4355-41a4-a8b0-e8508532b128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:23 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Volume 80c28fac-58cb-47a0-9c53-857116ded09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c28fac-58cb-47a0-9c53-857116ded09d', 'volume_size': 1} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (c9737689-1048-4db5-a84f-62fe7058f213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4aca1c-2ce9-4d78-a48a-2b29d68e4b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4aca1c-2ce9-4d78-a48a-2b29d68e4b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233230335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d08f88-76f3-42c3-9949-1ccce8ac8a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:24Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdbdff9-6c57-45ed-ba20-965db98cf37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdbdff9-6c57-45ed-ba20-965db98cf37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e24ac7c-3750-4fa8-8b1f-4ef758203eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e24ac7c-3750-4fa8-8b1f-4ef758203eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d08f88-76f3-42c3-9949-1ccce8ac8a6e', 'volume_name': 'volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:24 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af3715e-08d2-4118-9395-61c619a8ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af3715e-08d2-4118-9395-61c619a8ca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fb5b77-9493-4eee-9689-e344e3d42490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:24 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Volume c1d08f88-76f3-42c3-9949-1ccce8ac8a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e', 'volume_size': 1} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 1073741824" returned: 0 in 1.858s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:24 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 Jul 07 08:19:24 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:24 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6eb65183-d046-4578-ab30-87d56bcbefae" returned: 0 in 1.312s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "cinder-quobyte-6eb65183-d046-4578-ab30-87d56bcbefae" released by "delete_volume" :: held 2.713s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (770f99fb-a8bf-4433-85a7-8c08e8b9f1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8dd8c9-63dc-4bb0-9d55-ad4f5f3f7186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8dd8c9-63dc-4bb0-9d55-ad4f5f3f7186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824767703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c300e856-fc89-44dd-b985-a7db5970659c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:24Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de15678-017e-4748-b625-14e4dc34f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de15678-017e-4748-b625-14e4dc34f65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fafa4fe-79fb-40ed-95d3-ab32a79d029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fafa4fe-79fb-40ed-95d3-ab32a79d029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c300e856-fc89-44dd-b985-a7db5970659c', 'volume_name': 'volume-c300e856-fc89-44dd-b985-a7db5970659c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c18ab8e-0d91-462e-a2aa-fb2dc39b480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c18ab8e-0d91-462e-a2aa-fb2dc39b480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15641126-9251-4890-94a9-347188f9e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:24 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Volume c300e856-fc89-44dd-b985-a7db5970659c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c300e856-fc89-44dd-b985-a7db5970659c', 'volume_size': 1} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Created reservations ['cea7eb48-71f1-4d96-9684-5021d6dc51cd', '865fd309-e3aa-4178-b3e4-a2ce31ce1c26', 'f195e9be-8fcf-423e-be39-6c4710170677', '144be480-b3c5-4435-9f70-dc1f0bf23209'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:24 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:24 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "cinder-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (16030bb7-1798-4761-bdec-1ae70dcc4088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2b99b2-42f8-41e6-b143-d00e00f6f93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2b99b2-42f8-41e6-b143-d00e00f6f93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590402550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0350923d-1963-4b1a-a3e5-2232c971936c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:25Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973e8217-1f4b-4f9d-9709-1fe7a7548fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973e8217-1f4b-4f9d-9709-1fe7a7548fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cf2063-a6b6-422f-bed0-0b15a2a4971c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cf2063-a6b6-422f-bed0-0b15a2a4971c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0350923d-1963-4b1a-a3e5-2232c971936c', 'volume_name': 'volume-0350923d-1963-4b1a-a3e5-2232c971936c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2daba9-31ae-45f1-9043-33c41146c6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2daba9-31ae-45f1-9043-33c41146c6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:25 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cd660d-b38f-4a05-9d32-fe1975eeee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:25 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Volume 0350923d-1963-4b1a-a3e5-2232c971936c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0350923d-1963-4b1a-a3e5-2232c971936c', 'volume_size': 1} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "cinder-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c-delete_volume" acquired by "delete_volume" :: waited 0.209s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6" returned: 0 in 1.476s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] <== create_volume: return (3424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.431s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-107431352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c28fac-58cb-47a0-9c53-857116ded09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:23Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Creating volume 80c28fac-58cb-47a0-9c53-857116ded09d {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:25 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5228bc5-9a64-4983-a70b-6992240cc712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d95aa5-909c-4b60-ab9e-c4969029ece6', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28c0f07-5ab5-4f68-a933-63526d6b4ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:25 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d 1073741824 Jul 07 08:19:25 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:25 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Volume volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 (19d95aa5-909c-4b60-ab9e-c4969029ece6): created successfully Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28c0f07-5ab5-4f68-a933-63526d6b4ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (bd8e44ba-5d15-45f7-a975-663bdcdc025b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-85bc6a83-3c49-4387-b519-8e58f588c941 tempest-CreateVolumesFromImageTest-1882097092 None] Created volume successfully. Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "cinder-quobyte-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "cinder-quobyte-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc71b51-be05-47a5-9a51-013d33a0d876]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:25 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.281s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:25 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:25 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c Jul 07 08:19:25 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Deleted volume successfully. Jul 07 08:19:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c14c8860-912c-4c8f-b6bd-6f60e951f375 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "cinder-6eb65183-d046-4578-ab30-87d56bcbefae-delete_volume" released by "delete_volume" :: held 4.437s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:26 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c" returned: 0 in 0.922s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:26 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c Jul 07 08:19:26 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:26 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d 1073741824" returned: 0 in 1.258s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:26 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d Jul 07 08:19:26 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:27 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c" returned: 0 in 0.693s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "cinder-quobyte-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c" released by "delete_volume" :: held 1.683s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Created reservations ['cb1f3a03-0104-401f-9848-974f04cd66fc', '83872b88-0cb6-4f8f-a8a1-428a1134b229', '3a9bd08b-e235-4251-90ec-4d43c1b6c5af', 'b0985a6f-7045-4e88-9eb5-4b9927cf6473'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:27 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:27 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:27 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d" returned: 0 in 0.696s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.584s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233230335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d08f88-76f3-42c3-9949-1ccce8ac8a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:24Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Creating volume c1d08f88-76f3-42c3-9949-1ccce8ac8a6e {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:27 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:27 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e 1073741824 Jul 07 08:19:27 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86ed490-4355-41a4-a8b0-e8508532b128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c28fac-58cb-47a0-9c53-857116ded09d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66120d2-2b49-4cfb-8700-1b64aca43160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:27 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Volume volume-80c28fac-58cb-47a0-9c53-857116ded09d (80c28fac-58cb-47a0-9c53-857116ded09d): created successfully Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66120d2-2b49-4cfb-8700-1b64aca43160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (3c1340fc-be0c-4a85-81d4-08782cb30b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:27 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-580ffa73-f2f0-4c20-92c0-0cd74c4f6b2f tempest-CreateVolumesFromImageTest-1882097092 None] Created volume successfully. Jul 07 08:19:28 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.706s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:28 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:28 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Deleted volume successfully. Jul 07 08:19:28 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-329046aa-6d88-4416-a90e-1c18b2d76b84 tempest-TestServerVolumeAttachmentScenario-676011362 None] Lock "cinder-a2d93745-3ca8-4757-8776-2ba3c4b0aa4c-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:28 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e 1073741824" returned: 0 in 1.028s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:28 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e Jul 07 08:19:28 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:29 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e" returned: 0 in 0.700s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.908s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824767703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c300e856-fc89-44dd-b985-a7db5970659c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:24Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Creating volume c300e856-fc89-44dd-b985-a7db5970659c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:29 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fb5b77-9493-4eee-9689-e344e3d42490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584986a4-d055-466e-8e96-bc575f16831a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:29 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c 1073741824 Jul 07 08:19:29 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:29 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Volume volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e (c1d08f88-76f3-42c3-9949-1ccce8ac8a6e): created successfully Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584986a4-d055-466e-8e96-bc575f16831a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (c9737689-1048-4db5-a84f-62fe7058f213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f5170305-591a-4db6-bd2d-9beeadb0b9ad tempest-CreateVolumesFromImageTest-1882097092 None] Created volume successfully. Jul 07 08:19:30 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c 1073741824" returned: 0 in 1.195s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:30 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c Jul 07 08:19:30 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:31 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c" returned: 0 in 0.830s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.989s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590402550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0350923d-1963-4b1a-a3e5-2232c971936c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b8aa3606f14f5e8266d79103803287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:25Z,use_quota=True,user_id='b5b853153f7b4b658eba7544f201f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Creating volume 0350923d-1963-4b1a-a3e5-2232c971936c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:31 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:31 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c 1073741824 Jul 07 08:19:31 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15641126-9251-4890-94a9-347188f9e776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c300e856-fc89-44dd-b985-a7db5970659c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbac3d31-02a0-4d6c-b5ec-d57d5ee220f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Volume volume-c300e856-fc89-44dd-b985-a7db5970659c (c300e856-fc89-44dd-b985-a7db5970659c): created successfully Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbac3d31-02a0-4d6c-b5ec-d57d5ee220f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (770f99fb-a8bf-4433-85a7-8c08e8b9f1fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-75f696a0-867f-4d2b-a78a-a8b3f03cabe9 tempest-CreateVolumesFromImageTest-1882097092 None] Created volume successfully. Jul 07 08:19:32 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c 1073741824" returned: 0 in 1.137s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:32 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c Jul 07 08:19:32 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:33 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c" returned: 0 in 0.701s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11cd660d-b38f-4a05-9d32-fe1975eeee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0350923d-1963-4b1a-a3e5-2232c971936c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d6acad-1ddf-4d60-a5d0-a3402aeeea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Volume volume-0350923d-1963-4b1a-a3e5-2232c971936c (0350923d-1963-4b1a-a3e5-2232c971936c): created successfully Jul 07 08:19:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d6acad-1ddf-4d60-a5d0-a3402aeeea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Flow 'volume_create_manager' (16030bb7-1798-4761-bdec-1ae70dcc4088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-03a8849c-fc0a-4493-9ea8-25b762633a80 tempest-CreateVolumesFromImageTest-1882097092 None] Created volume successfully. Jul 07 08:19:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-0350923d-1963-4b1a-a3e5-2232c971936c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-0350923d-1963-4b1a-a3e5-2232c971936c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-quobyte-0350923d-1963-4b1a-a3e5-2232c971936c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-0350923d-1963-4b1a-a3e5-2232c971936c" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:34 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f3068a-4424-4430-9f50-3c748679680f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:34 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c Jul 07 08:19:34 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:35 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c" returned: 0 in 0.974s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:35 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c Jul 07 08:19:35 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:36 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0350923d-1963-4b1a-a3e5-2232c971936c" returned: 0 in 1.247s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-0350923d-1963-4b1a-a3e5-2232c971936c" released by "delete_volume" :: held 2.318s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:36 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Created reservations ['9d7191d5-29ab-4dee-838a-ba74caacb5a7', 'cf15015b-7ae1-43dc-af79-543b7f85f787', '3798976d-37e4-4b5d-a5f4-08485b96c9a1', 'ce009eb1-3e7b-4ad1-8637-46149c60d4c4'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:36 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:36 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-c300e856-fc89-44dd-b985-a7db5970659c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-c300e856-fc89-44dd-b985-a7db5970659c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-quobyte-c300e856-fc89-44dd-b985-a7db5970659c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-c300e856-fc89-44dd-b985-a7db5970659c" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:37 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.029s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:37 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:37 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Deleted volume successfully. Jul 07 08:19:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeec69b7-49f3-40cd-8381-30dc39798e09]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a485739d-9c00-455d-abf5-f3689c7e38ab tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-0350923d-1963-4b1a-a3e5-2232c971936c-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:37 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c Jul 07 08:19:37 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:38 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c" returned: 0 in 1.031s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:38 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c Jul 07 08:19:38 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:39 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c300e856-fc89-44dd-b985-a7db5970659c" returned: 0 in 0.939s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-c300e856-fc89-44dd-b985-a7db5970659c" released by "delete_volume" :: held 2.045s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:39 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=94,cinder:SELECT=77,cinder:INSERT=21,cinder:DELETE=7 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:19:39 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Created reservations ['358258f6-ddb3-4f7c-b57c-d3542a4f5bff', '8b786a0e-adee-4cd1-8f18-86d280cbf0be', '72e9703e-7ae5-44c2-9fff-7d4af70e965f', 'ca1c53de-04ad-429b-b951-bd7909488e5c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:40 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:40 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-quobyte-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e" acquired by "delete_volume" :: waited 0.031s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[839c19e5-4636-4c19-85fa-6b5a9cfc819f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:40 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e Jul 07 08:19:40 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:41 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.304s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:41 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Deleted volume successfully. Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d2a039a9-1ad5-4b53-b8d5-2b4bdb689cfe tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-c300e856-fc89-44dd-b985-a7db5970659c-delete_volume" released by "delete_volume" :: held 3.696s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:41 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e" returned: 0 in 1.350s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:41 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e Jul 07 08:19:41 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Flow 'volume_create_manager' (fcd8e97a-1b30-4d9f-9691-72497ae2d643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb7bfd3-6cab-4949-a02f-74afd35eecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb7bfd3-6cab-4949-a02f-74afd35eecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1076142605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf2d3dd-8286-4e95-84a6-84481434ae49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4bde109a148a28951a0552661ab30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:42Z,use_quota=True,user_id='432724a9b08e4c2bbc56d55342052387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cb74b6-b6d7-40b0-bd10-74b2ebf0ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90cb74b6-b6d7-40b0-bd10-74b2ebf0ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043efb5c-bbac-4fa0-908b-fa3af5f6f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043efb5c-bbac-4fa0-908b-fa3af5f6f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf2d3dd-8286-4e95-84a6-84481434ae49', 'volume_name': 'volume-0bf2d3dd-8286-4e95-84a6-84481434ae49', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dcf12e5-b9e4-4b78-9a34-b8cd3a4622cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dcf12e5-b9e4-4b78-9a34-b8cd3a4622cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69aae71-f753-4def-8c3d-6a03028f166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:41 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Volume 0bf2d3dd-8286-4e95-84a6-84481434ae49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf2d3dd-8286-4e95-84a6-84481434ae49', 'volume_size': 1} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1076142605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf2d3dd-8286-4e95-84a6-84481434ae49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4bde109a148a28951a0552661ab30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:42Z,use_quota=True,user_id='432724a9b08e4c2bbc56d55342052387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Creating volume 0bf2d3dd-8286-4e95-84a6-84481434ae49 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:41 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:19:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:41 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 1073741824 Jul 07 08:19:41 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:42 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e" returned: 0 in 1.294s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e" released by "delete_volume" :: held 2.739s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Created reservations ['dbde5438-8963-4fb6-818f-44f31457f2ce', 'de876b8c-924d-4322-85a5-e34c45316833', '719e545f-38ea-46db-b25a-8982a2dd55f2', 'b5dd2480-ea82-4700-bd0a-e5562bb3ae88'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:43 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:43 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:43 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 1073741824" returned: 0 in 1.605s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:43 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 Jul 07 08:19:43 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-80c28fac-58cb-47a0-9c53-857116ded09d-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-80c28fac-58cb-47a0-9c53-857116ded09d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-quobyte-80c28fac-58cb-47a0-9c53-857116ded09d" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-80c28fac-58cb-47a0-9c53-857116ded09d" acquired by "delete_volume" :: waited 0.045s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7cf983-cb1f-4f53-9e36-56d4d623ea32]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:44 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d Jul 07 08:19:44 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:45 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.789s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Deleted volume successfully. Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6e9bbd3d-b1d1-42a2-a8e1-c5faaf006fb0 tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-c1d08f88-76f3-42c3-9949-1ccce8ac8a6e-delete_volume" released by "delete_volume" :: held 4.937s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:45 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49" returned: 0 in 1.644s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] <== create_volume: return (3342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.344s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69aae71-f753-4def-8c3d-6a03028f166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf2d3dd-8286-4e95-84a6-84481434ae49', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb54939-f598-4112-a4bc-1c9b5e76f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:45 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Volume volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 (0bf2d3dd-8286-4e95-84a6-84481434ae49): created successfully Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb54939-f598-4112-a4bc-1c9b5e76f26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:45 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Flow 'volume_create_manager' (fcd8e97a-1b30-4d9f-9691-72497ae2d643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d" returned: 0 in 1.184s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2d525b99-f764-44d8-9a6f-58e82218b4c6 tempest-AttachVolumeTestJSON-1912319260 None] Created volume successfully. Jul 07 08:19:45 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d Jul 07 08:19:45 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:45 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80c28fac-58cb-47a0-9c53-857116ded09d" returned: 0 in 0.688s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-80c28fac-58cb-47a0-9c53-857116ded09d" released by "delete_volume" :: held 1.958s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Created reservations ['d790557d-90d6-4fff-827e-46a37850b990', 'a9e1e216-7eca-459f-992b-b2ac08456550', '1351f0d8-40bf-4af7-883e-42c4b30be410', '21e38bd2-4ad0-4588-9a03-027cc5cdb434'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:46 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:46 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-19d95aa5-909c-4b60-ab9e-c4969029ece6-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-19d95aa5-909c-4b60-ab9e-c4969029ece6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "cinder-quobyte-19d95aa5-909c-4b60-ab9e-c4969029ece6" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-19d95aa5-909c-4b60-ab9e-c4969029ece6" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6609e01-4ae1-4943-b6a5-3ea41efddcdd]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:46 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 Jul 07 08:19:46 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:47 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.001s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:47 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Deleted volume successfully. Jul 07 08:19:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d4c37cca-b72a-4484-abdb-22401f6f0fdc tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-80c28fac-58cb-47a0-9c53-857116ded09d-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:47 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6" returned: 0 in 0.967s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:47 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6 Jul 07 08:19:47 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:48 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19d95aa5-909c-4b60-ab9e-c4969029ece6" returned: 0 in 1.063s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-quobyte-19d95aa5-909c-4b60-ab9e-c4969029ece6" released by "delete_volume" :: held 2.093s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Created reservations ['00597113-ce2b-498a-b396-a0fef0cd00fb', 'b0a85760-7911-495a-a6ec-13dd2b937f05', '7805b4b5-bd46-4665-9cdd-5e9127ff6ab8', '84b34829-3d17-429c-b957-94ea4e8a9b5a'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:19:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:48 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:19:48 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:49 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.776s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:49 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:19:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Deleted volume successfully. Jul 07 08:19:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2986872e-3e9d-4699-9f3d-16c545300c0a tempest-CreateVolumesFromImageTest-1882097092 None] Lock "cinder-19d95aa5-909c-4b60-ab9e-c4969029ece6-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:19:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-20b7a6f5-489a-4905-ab1e-9e0830f82bc7 req-0cb1d757-52f6-4c9c-b07e-c6e4d1ac3439 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-20b7a6f5-489a-4905-ab1e-9e0830f82bc7 req-0cb1d757-52f6-4c9c-b07e-c6e4d1ac3439 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:49 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c885830b-cfee-4ebc-8499-4ebbb9dea175]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-20b7a6f5-489a-4905-ab1e-9e0830f82bc7 req-0cb1d757-52f6-4c9c-b07e-c6e4d1ac3439 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:49 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 Jul 07 08:19:49 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:50 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-20b7a6f5-489a-4905-ab1e-9e0830f82bc7 req-0cb1d757-52f6-4c9c-b07e-c6e4d1ac3439 tempest-AttachVolumeTestJSON-1912319260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49" returned: 0 in 1.035s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-20b7a6f5-489a-4905-ab1e-9e0830f82bc7 req-0cb1d757-52f6-4c9c-b07e-c6e4d1ac3439 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.064s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-20b7a6f5-489a-4905-ab1e-9e0830f82bc7 req-0cb1d757-52f6-4c9c-b07e-c6e4d1ac3439 tempest-AttachVolumeTestJSON-1912319260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-0bf2d3dd-8286-4e95-84a6-84481434ae49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c73023d1-42f5-4e61-b3ad-a059a7074d68', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:19:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-20b7a6f5-489a-4905-ab1e-9e0830f82bc7 req-0cb1d757-52f6-4c9c-b07e-c6e4d1ac3439 tempest-AttachVolumeTestJSON-1912319260 None] attachment_update completed successfully. Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Flow 'volume_create_manager' (590edc1d-1192-48bd-8082-0a43894eae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09a4817-3444-46c5-a42c-6597e210d21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09a4817-3444-46c5-a42c-6597e210d21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2037592833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff5404d-720d-46cb-880e-c6e03af08c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbfb01f5293b4fed8896cde5e2845615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:54Z,use_quota=True,user_id='2c84012ec8224d65b1413a32301c2fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04772b2-0809-432c-ac3f-a404b1f23111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04772b2-0809-432c-ac3f-a404b1f23111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0484c1-753c-41da-81f6-00d5ff8ea69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0484c1-753c-41da-81f6-00d5ff8ea69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff5404d-720d-46cb-880e-c6e03af08c6f', 'volume_name': 'volume-3ff5404d-720d-46cb-880e-c6e03af08c6f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1229c9-f092-4ff4-9208-ef03349f54ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1229c9-f092-4ff4-9208-ef03349f54ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e0b602-06af-422f-b808-ff47d2f89af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:53 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Volume 3ff5404d-720d-46cb-880e-c6e03af08c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff5404d-720d-46cb-880e-c6e03af08c6f', 'volume_size': 1} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2037592833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff5404d-720d-46cb-880e-c6e03af08c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbfb01f5293b4fed8896cde5e2845615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:54Z,use_quota=True,user_id='2c84012ec8224d65b1413a32301c2fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Creating volume 3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:19:53 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:19:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:53 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f 1073741824 Jul 07 08:19:53 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:54 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f 1073741824" returned: 0 in 0.912s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:54 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f Jul 07 08:19:54 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:55 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f" returned: 0 in 0.754s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e0b602-06af-422f-b808-ff47d2f89af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff5404d-720d-46cb-880e-c6e03af08c6f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebf741c-db8b-4e6e-9de8-99c20fc50e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:55 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Volume volume-3ff5404d-720d-46cb-880e-c6e03af08c6f (3ff5404d-720d-46cb-880e-c6e03af08c6f): created successfully Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebf741c-db8b-4e6e-9de8-99c20fc50e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Flow 'volume_create_manager' (590edc1d-1192-48bd-8082-0a43894eae74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9406dcea-649f-4e1a-9bf4-c96fe8fc2a13 tempest-VolumeDependencyTests-1400505967 None] Created volume successfully. Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Creating offline snapshot b0aa33df-4635-4e91-b62e-ab08323954a0 of volume 3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caa088f-8ff0-430c-8aad-1f8d0a3a18a6]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:19:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:56 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f Jul 07 08:19:56 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Flow 'volume_create_manager' (b0810d17-f199-489e-820a-68a49caefd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d21f3e3-fae6-4297-9e8e-44715a22f302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d21f3e3-fae6-4297-9e8e-44715a22f302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1025471708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c905a5d-eb04-4095-b026-d179ecaa0428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4bde109a148a28951a0552661ab30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:56Z,use_quota=True,user_id='432724a9b08e4c2bbc56d55342052387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3068ef-8f26-40c7-b209-0a94dbb0b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3068ef-8f26-40c7-b209-0a94dbb0b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaa63f1-851f-45cb-a35b-e0764ced02ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aaa63f1-851f-45cb-a35b-e0764ced02ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c905a5d-eb04-4095-b026-d179ecaa0428', 'volume_name': 'volume-8c905a5d-eb04-4095-b026-d179ecaa0428', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eee9ba9-b132-4293-94e8-550b79b27842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eee9ba9-b132-4293-94e8-550b79b27842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1b5ec0-f166-4034-8ac0-3db4cb3ba8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:19:56 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Volume 8c905a5d-eb04-4095-b026-d179ecaa0428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c905a5d-eb04-4095-b026-d179ecaa0428', 'volume_size': 1} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:19:56 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f" returned: 0 in 0.846s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:56 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 1G Jul 07 08:19:56 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:57 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 1G" returned: 0 in 0.862s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff5404d-720d-46cb-880e-c6e03af08c6f -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:57 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff5404d-720d-46cb-880e-c6e03af08c6f -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 Jul 07 08:19:57 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:58 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ff5404d-720d-46cb-880e-c6e03af08c6f -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0" returned: 0 in 0.838s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:58 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 is being set with open permissions: ugo+rw Jul 07 08:19:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:58 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 Jul 07 08:19:58 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:59 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0" returned: 0 in 0.662s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:59 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.info Jul 07 08:19:59 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:19:59 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jul 07 08:19:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.info" returned: 0 in 0.754s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:19:59 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.info is being set with open permissions: ugo+rw Jul 07 08:19:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:19:59 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.info Jul 07 08:19:59 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:00 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.info" returned: 0 in 0.650s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.734s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.171s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1025471708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c905a5d-eb04-4095-b026-d179ecaa0428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d4bde109a148a28951a0552661ab30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:19:56Z,use_quota=True,user_id='432724a9b08e4c2bbc56d55342052387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Creating volume 8c905a5d-eb04-4095-b026-d179ecaa0428 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:00 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:20:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:00 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 1073741824 Jul 07 08:20:00 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:00 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-59a1bc61-a078-4981-a565-901d60152c41 tempest-VolumeDependencyTests-1400505967 None] Create snapshot completed successfully Jul 07 08:20:01 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 1073741824" returned: 0 in 1.111s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:01 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 Jul 07 08:20:01 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Flow 'volume_create_manager' (697fe5b8-214c-4a0c-9bcf-8535e181c8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebdf43c-6e13-4418-a6f2-5b39b6277a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebdf43c-6e13-4418-a6f2-5b39b6277a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-895943258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1dbdf68-6b82-4687-b1ad-85e278e792ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbfb01f5293b4fed8896cde5e2845615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b0aa33df-4635-4e91-b62e-ab08323954a0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:02Z,use_quota=True,user_id='2c84012ec8224d65b1413a32301c2fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01266dd-40b4-49b5-9dc3-3bb334c936e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01266dd-40b4-49b5-9dc3-3bb334c936e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd654956-6ff0-4d81-8e14-9cfd1b5fb476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd654956-6ff0-4d81-8e14-9cfd1b5fb476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a1dbdf68-6b82-4687-b1ad-85e278e792ba', 'volume_name': 'volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba', 'volume_size': 1, 'snapshot_id': 'b0aa33df-4635-4e91-b62e-ab08323954a0'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed63d31d-0a2e-40d6-a210-a129713a25ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed63d31d-0a2e-40d6-a210-a129713a25ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc623c0-2b4f-4115-a845-fd050c236ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Volume a1dbdf68-6b82-4687-b1ad-85e278e792ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba', 'volume_size': 1, 'snapshot_id': 'b0aa33df-4635-4e91-b62e-ab08323954a0'} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:02 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428" returned: 0 in 0.924s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.556s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "cinder-quobyte-b0aa33df-4635-4e91-b62e-ab08323954a0-a1dbdf68-6b82-4687-b1ad-85e278e792ba" by "_create_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-b0aa33df-4635-4e91-b62e-ab08323954a0-a1dbdf68-6b82-4687-b1ad-85e278e792ba" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Creating volume a1dbdf68-6b82-4687-b1ad-85e278e792ba from snapshot b0aa33df-4635-4e91-b62e-ab08323954a0 {{(pid=87179) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "cinder-quobyte-a1dbdf68-6b82-4687-b1ad-85e278e792ba" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1b5ec0-f166-4034-8ac0-3db4cb3ba8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c905a5d-eb04-4095-b026-d179ecaa0428', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c9cfed-ab12-4227-8535-a081f5d613fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-a1dbdf68-6b82-4687-b1ad-85e278e792ba" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] snapshot: b0aa33df-4635-4e91-b62e-ab08323954a0, volume: a1dbdf68-6b82-4687-b1ad-85e278e792ba, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:02 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Volume volume-8c905a5d-eb04-4095-b026-d179ecaa0428 (8c905a5d-eb04-4095-b026-d179ecaa0428): created successfully Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c9cfed-ab12-4227-8535-a081f5d613fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Flow 'volume_create_manager' (b0810d17-f199-489e-820a-68a49caefd11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1320962f-7d21-42e1-b561-e981349ef8b2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:02 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-65499a90-9b23-48be-aecc-6e2c5cce182b tempest-AttachVolumeTestJSON-1912319260 None] Created volume successfully. Jul 07 08:20:03 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 Jul 07 08:20:03 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Flow 'volume_create_manager' (251acee4-32bf-4664-a7cb-4251fa5f83bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16b5383-55b4-4895-80fc-9c3af5c86a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:04 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16b5383-55b4-4895-80fc-9c3af5c86a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-518502649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d584da7-e126-4c8d-9d85-8cd76772ec50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20957cc427342038b4f13f2ebd2b379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:04Z,use_quota=True,user_id='224a628e1b0643799204ed9bad6bf0ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d05ab20-4d9f-4ac6-8c1e-964819185237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d05ab20-4d9f-4ac6-8c1e-964819185237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f645c456-0891-48c1-8951-6ba9de87a5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f645c456-0891-48c1-8951-6ba9de87a5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d584da7-e126-4c8d-9d85-8cd76772ec50', 'volume_name': 'volume-4d584da7-e126-4c8d-9d85-8cd76772ec50', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35215ce3-d321-4bef-aa3f-472ebd57e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35215ce3-d321-4bef-aa3f-472ebd57e75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd4fc83-7bd2-4a77-853a-af160aa1266f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:04 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Volume 4d584da7-e126-4c8d-9d85-8cd76772ec50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d584da7-e126-4c8d-9d85-8cd76772ec50', 'volume_size': 1} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0" returned: 0 in 1.348s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ff5404d-720d-46cb-880e-c6e03af08c6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f0a15-8b79-4d01-a584-aedfd08d4f8e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:04 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f Jul 07 08:20:04 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:04 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:04 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:05 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f" returned: 0 in 0.834s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:05 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:20:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:05 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba Jul 07 08:20:05 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:05 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.770s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:20:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:20:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:20:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-0a14443e-8b7c-40ef-ac78-6112af9febe0 req-d59ca857-f673-4730-b958-15fcb48ba499 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:10 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba" returned: 0 in 5.462s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:10 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f839b998-7f52-49e7-ba06-517163615d67]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:10 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f Jul 07 08:20:10 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:11 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f" returned: 0 in 0.949s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:11 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:20:11 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Converted 1024.00 MB image at 187.44 MB/s Jul 07 08:20:11 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba is being set with open permissions: ugo+rw Jul 07 08:20:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:11 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba Jul 07 08:20:11 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:12 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba" returned: 0 in 0.666s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-a1dbdf68-6b82-4687-b1ad-85e278e792ba" released by "_copy_volume_from_snapshot" :: held 9.369s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-b0aa33df-4635-4e91-b62e-ab08323954a0-a1dbdf68-6b82-4687-b1ad-85e278e792ba" released by "_create_volume_from_snapshot" :: held 9.415s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.441s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.969s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-518502649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d584da7-e126-4c8d-9d85-8cd76772ec50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20957cc427342038b4f13f2ebd2b379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:04Z,use_quota=True,user_id='224a628e1b0643799204ed9bad6bf0ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Creating volume 4d584da7-e126-4c8d-9d85-8cd76772ec50 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:12 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:12 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 1073741824 Jul 07 08:20:12 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc623c0-2b4f-4115-a845-fd050c236ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba', 'volume_size': 1, 'snapshot_id': 'b0aa33df-4635-4e91-b62e-ab08323954a0'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f77630-4ed2-4088-8f21-3cfc0c65d101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:12 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Volume volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba (a1dbdf68-6b82-4687-b1ad-85e278e792ba): created successfully Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f77630-4ed2-4088-8f21-3cfc0c65d101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Flow 'volume_create_manager' (697fe5b8-214c-4a0c-9bcf-8535e181c8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:12 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c8321a34-21dd-4b56-847e-36782e473b2e tempest-VolumeDependencyTests-1400505967 None] Created volume successfully. Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Flow 'volume_create_manager' (831faf06-7e2b-4228-836d-c37773639be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53245982-db63-4271-8fd4-5d44eb65c4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53245982-db63-4271-8fd4-5d44eb65c4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1396373562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5014d5d6-f913-4466-8ec9-019c7f895340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e54eb6ea7ff40fc837d957b9fd3d0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:13Z,use_quota=True,user_id='5583bac76e774ce89ff89a95b9e63e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885007c2-ca2e-448c-a9b3-bcb0df4ccc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885007c2-ca2e-448c-a9b3-bcb0df4ccc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0955d5cb-b220-430b-843a-fe6863c14132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:12 devstack cinder-volume[87179]: DEBUG cinder.image.glance [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Creating Keystone auth plugin from conf {{(pid=87179) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "cinder-b0aa33df-4635-4e91-b62e-ab08323954a0-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:13 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 1073741824" returned: 0 in 0.903s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-b0aa33df-4635-4e91-b62e-ab08323954a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "cinder-quobyte-3ff5404d-720d-46cb-880e-c6e03af08c6f" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-3ff5404d-720d-46cb-880e-c6e03af08c6f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "cinder-quobyte-b0aa33df-4635-4e91-b62e-ab08323954a0" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-b0aa33df-4635-4e91-b62e-ab08323954a0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Deleting offline snapshot b0aa33df-4635-4e91-b62e-ab08323954a0 of volume 3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] snapshot_file for this snap is: volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03fe7d2-237e-417e-89f8-7d983f29baa3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:13 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 Jul 07 08:20:13 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:13 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 Jul 07 08:20:13 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0955d5cb-b220-430b-843a-fe6863c14132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5014d5d6-f913-4466-8ec9-019c7f895340', 'volume_name': 'volume-5014d5d6-f913-4466-8ec9-019c7f895340', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d6518c-ec2d-4114-b126-b61afff2015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d6518c-ec2d-4114-b126-b61afff2015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff3133b-4313-4471-8c67-9912141291f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:13 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Volume 5014d5d6-f913-4466-8ec9-019c7f895340: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5014d5d6-f913-4466-8ec9-019c7f895340', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Trying to clone 5014d5d6-f913-4466-8ec9-019c7f895340 from image d183b53e-6225-438a-8e28-29fd7f440861 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]). {{(pid=87179) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:20:13 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Image download 20.69 MB at 20.69 MB/s Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1568b6c-7336-4d72-b8f1-3b54cbfc0711]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:13 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50" returned: 0 in 0.821s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-0a14443e-8b7c-40ef-ac78-6112af9febe0 req-d59ca857-f673-4730-b958-15fcb48ba499 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.160s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c860c0aa-0408-4134-9214-90fd7bda5575]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd4fc83-7bd2-4a77-853a-af160aa1266f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d584da7-e126-4c8d-9d85-8cd76772ec50', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3e6fb1-8642-4889-958c-32ddabcd0e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-0a14443e-8b7c-40ef-ac78-6112af9febe0 req-d59ca857-f673-4730-b958-15fcb48ba499 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:14 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Volume volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 (4d584da7-e126-4c8d-9d85-8cd76772ec50): created successfully Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3e6fb1-8642-4889-958c-32ddabcd0e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:14 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD Jul 07 08:20:14 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Flow 'volume_create_manager' (251acee4-32bf-4664-a7cb-4251fa5f83bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b6951917-0a3f-4dad-bea3-a79cdd198209 tempest-AttachVolumeShelveTestJSON-1678255963 None] Created volume successfully. Jul 07 08:20:14 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0" returned: 0 in 0.974s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ff5404d-720d-46cb-880e-c6e03af08c6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:20:14 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 Jul 07 08:20:14 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3ca269-adcc-43c1-b72b-3f29c35604ed]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:14 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f Jul 07 08:20:14 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:14 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD" returned: 0 in 0.840s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Temporary image d183b53e-6225-438a-8e28-29fd7f440861 is fetched for user 5583bac76e774ce89ff89a95b9e63e15. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f7427c-82e2-41d7-8924-ca532c859174]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:14 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-0a14443e-8b7c-40ef-ac78-6112af9febe0 req-d59ca857-f673-4730-b958-15fcb48ba499 tempest-AttachVolumeTestJSON-1912319260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428" returned: 0 in 0.816s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-0a14443e-8b7c-40ef-ac78-6112af9febe0 req-d59ca857-f673-4730-b958-15fcb48ba499 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.853s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-0a14443e-8b7c-40ef-ac78-6112af9febe0 req-d59ca857-f673-4730-b958-15fcb48ba499 tempest-AttachVolumeTestJSON-1912319260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-8c905a5d-eb04-4095-b026-d179ecaa0428', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ded19baa-a7d8-4f20-b8d7-85e0fed2213e', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:20:14 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD Jul 07 08:20:14 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-0a14443e-8b7c-40ef-ac78-6112af9febe0 req-d59ca857-f673-4730-b958-15fcb48ba499 tempest-AttachVolumeTestJSON-1912319260 None] attachment_update completed successfully. Jul 07 08:20:14 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f" returned: 0 in 0.795s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:14 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 Jul 07 08:20:14 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:15 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD" returned: 0 in 0.835s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1396373562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5014d5d6-f913-4466-8ec9-019c7f895340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e54eb6ea7ff40fc837d957b9fd3d0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:13Z,use_quota=True,user_id='5583bac76e774ce89ff89a95b9e63e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Creating volume 5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:15 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:15 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 1073741824 Jul 07 08:20:15 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:15 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0" returned: 0 in 0.789s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:15 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0 Jul 07 08:20:15 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:16 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f.b0aa33df-4635-4e91-b62e-ab08323954a0" returned: 0 in 0.749s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-b0aa33df-4635-4e91-b62e-ab08323954a0" released by "_delete_snapshot" :: held 3.418s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-3ff5404d-720d-46cb-880e-c6e03af08c6f" released by "delete_snapshot" :: held 3.446s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:16 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Created reservations ['53885379-64ad-4328-abd0-a39ff49e11d6', 'f5ac1355-461e-4e78-a6a9-245003585a20', '955e33ce-8dfb-42f1-b595-207db5ba5655', 'f068d283-cd95-4d32-bb37-7ec216d6d44d'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:16 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 1073741824" returned: 0 in 0.999s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:16 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Delete snapshot completed successfully. Jul 07 08:20:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-75803be3-4591-46d0-9f35-6705d3416ca0 tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-b0aa33df-4635-4e91-b62e-ab08323954a0-delete_snapshot" released by "delete_snapshot" :: held 3.644s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:16 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:20:16 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "cinder-3ff5404d-720d-46cb-880e-c6e03af08c6f-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:17 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-3ff5404d-720d-46cb-880e-c6e03af08c6f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 0 in 0.638s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Attempting download of d183b53e-6225-438a-8e28-29fd7f440861 ((None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}])) to volume 5014d5d6-f913-4466-8ec9-019c7f895340. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "cinder-quobyte-3ff5404d-720d-46cb-880e-c6e03af08c6f" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-3ff5404d-720d-46cb-880e-c6e03af08c6f" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d99613-4ac1-4832-9965-99a40b9f73f9]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbf4d0c-ea92-41c9-81d7-126bc2390210]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_iqpfaxb6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:17 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f Jul 07 08:20:17 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:17 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_iqpfaxb6 Jul 07 08:20:17 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:18 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:18 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f" returned: 0 in 0.788s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_iqpfaxb6" returned: 0 in 0.778s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_iqpfaxb6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:18 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f Jul 07 08:20:18 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:18 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_iqpfaxb6 Jul 07 08:20:18 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:18 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ff5404d-720d-46cb-880e-c6e03af08c6f" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-3ff5404d-720d-46cb-880e-c6e03af08c6f" released by "delete_volume" :: held 1.524s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:18 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Created reservations ['c95ad772-4ee1-4f45-a130-9cb3547ce828', '06f899d4-ff1b-4c0d-983f-8e4dbe64fef9', '190ea080-b3c1-4df7-8457-a51c94a5d6bf', 'b0fbb78c-51b1-4bf4-9db0-d47a87f122a9'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:19 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_iqpfaxb6" returned: 1 in 0.768s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_iqpfaxb6' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eedf516-5a26-438f-96a9-4887e29bc2c8]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:19 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:19 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:19 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD Jul 07 08:20:19 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "cinder-a1dbdf68-6b82-4687-b1ad-85e278e792ba-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-a1dbdf68-6b82-4687-b1ad-85e278e792ba-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "cinder-quobyte-a1dbdf68-6b82-4687-b1ad-85e278e792ba" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-a1dbdf68-6b82-4687-b1ad-85e278e792ba" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b596d9-b21e-4cd7-8408-245bb0e4aa2d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:19 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba Jul 07 08:20:19 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:19 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.790s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:19 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Deleted volume successfully. Jul 07 08:20:19 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD" returned: 0 in 0.865s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] d183b53e-6225-438a-8e28-29fd7f440861 was qcow2, converting to raw {{(pid=87179) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2955cd7a-150f-464b-b3e9-2badae1c865e tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-3ff5404d-720d-46cb-880e-c6e03af08c6f-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:19 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:20:19 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:20 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba" returned: 0 in 0.914s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:20 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba Jul 07 08:20:20 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:21 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a1dbdf68-6b82-4687-b1ad-85e278e792ba" returned: 0 in 0.683s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-quobyte-a1dbdf68-6b82-4687-b1ad-85e278e792ba" released by "delete_volume" :: held 1.654s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=92,cinder:UPDATE=107,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Created reservations ['f551a1ec-ece9-4bc3-81db-45fe90b557f2', '36ea5f77-ea46-4ffd-81d9-ff7b84216105', '8743a9bb-122a-4657-ad16-e436fae6583b', '6364f045-519b-42bb-b2b7-ca5ad776ad77'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:21 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:21 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-ecf30be3-01b6-4baa-8c98-457370c106b4 req-3569f7b3-5eeb-47b2-b2e7-b9785fc4bad8 tempest-AttachVolumeTestJSON-1912319260 None] Terminate volume connection completed successfully. Jul 07 08:20:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-ecf30be3-01b6-4baa-8c98-457370c106b4 req-3569f7b3-5eeb-47b2-b2e7-b9785fc4bad8 tempest-AttachVolumeTestJSON-1912319260 None] Deleting attachment c73023d1-42f5-4e61-b3ad-a059a7074d68. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:20:22 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 0 in 2.399s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:22 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_dz_8hzvtdevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:20:22 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Converted 112.00 MB image at 46.64 MB/s Jul 07 08:20:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:22 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 1G Jul 07 08:20:22 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:22 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.934s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:22 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Deleted volume successfully. Jul 07 08:20:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f65f090c-7178-42a0-89be-267675495d1d tempest-VolumeDependencyTests-1400505967 None] Lock "cinder-a1dbdf68-6b82-4687-b1ad-85e278e792ba-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:23 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 1G" returned: 0 in 0.908s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1cd609-4c75-4a55-ab88-fe72dbc08d30]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:23 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:20:23 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:24 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 0 in 0.952s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-54a735c1-866c-4ca1-8e45-a02e0a19cddc req-90d5ba0f-093a-48d1-a6b5-1a0441c4df6d tempest-AttachVolumeTestJSON-1912319260 None] Terminate volume connection completed successfully. Jul 07 08:20:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-54a735c1-866c-4ca1-8e45-a02e0a19cddc req-90d5ba0f-093a-48d1-a6b5-1a0441c4df6d tempest-AttachVolumeTestJSON-1912319260 None] Deleting attachment ded19baa-a7d8-4f20-b8d7-85e0fed2213e. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:20:24 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:20:24 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:25 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 1 in 1.018s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Downloaded image d183b53e-6225-438a-8e28-29fd7f440861 ((None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}])) to volume 5014d5d6-f913-4466-8ec9-019c7f895340 successfully. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Temporary image d183b53e-6225-438a-8e28-29fd7f440861 for user 5583bac76e774ce89ff89a95b9e63e15 is deleted. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Marking volume 5014d5d6-f913-4466-8ec9-019c7f895340 as bootable. {{(pid=87179) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Copying metadata from image d183b53e-6225-438a-8e28-29fd7f440861 to 5014d5d6-f913-4466-8ec9-019c7f895340. {{(pid=87179) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Creating volume glance metadata for volume 5014d5d6-f913-4466-8ec9-019c7f895340 backed by image d183b53e-6225-438a-8e28-29fd7f440861 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87179) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff3133b-4313-4471-8c67-9912141291f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5014d5d6-f913-4466-8ec9-019c7f895340', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8ff6c0-024f-4b4d-b99d-2edf4aaf8893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:25 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Volume volume-5014d5d6-f913-4466-8ec9-019c7f895340 (5014d5d6-f913-4466-8ec9-019c7f895340): created successfully Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8ff6c0-024f-4b4d-b99d-2edf4aaf8893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Flow 'volume_create_manager' (831faf06-7e2b-4228-836d-c37773639be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e29be697-978b-447d-84f7-025d5e49b1a1 tempest-TestShelveInstance-1136546494 None] Created volume successfully. Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Flow 'volume_create_manager' (fbfdd5c5-8db0-437c-943c-b47d6034b5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cebf09c-c5a1-4f6c-9e98-7755b4755983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cebf09c-c5a1-4f6c-9e98-7755b4755983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-743005897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e93621-1726-4791-93ba-ac810492591d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d586ac3f943544e49c424b95c01395ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:26Z,use_quota=True,user_id='d7a110df45df4ab781fbb02f271bb9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3a1247-58fb-4514-b3dc-08ef581969e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3a1247-58fb-4514-b3dc-08ef581969e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa386029-11c2-423d-986b-665ecd4bf98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa386029-11c2-423d-986b-665ecd4bf98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e93621-1726-4791-93ba-ac810492591d', 'volume_name': 'volume-c0e93621-1726-4791-93ba-ac810492591d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e2ff16-77e1-4604-96ad-c7678d80d9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e2ff16-77e1-4604-96ad-c7678d80d9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d598cc0-ca89-46c0-bd8c-b5c73a0f3f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:26 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Volume c0e93621-1726-4791-93ba-ac810492591d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e93621-1726-4791-93ba-ac810492591d', 'volume_size': 1} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-743005897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e93621-1726-4791-93ba-ac810492591d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d586ac3f943544e49c424b95c01395ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:26Z,use_quota=True,user_id='d7a110df45df4ab781fbb02f271bb9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Creating volume c0e93621-1726-4791-93ba-ac810492591d {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:26 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:20:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:26 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d 1073741824 Jul 07 08:20:26 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:27 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d 1073741824" returned: 0 in 1.108s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:27 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d Jul 07 08:20:27 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:28 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d" returned: 0 in 0.763s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d598cc0-ca89-46c0-bd8c-b5c73a0f3f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e93621-1726-4791-93ba-ac810492591d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585a77f4-9711-467c-a775-e18034232431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:28 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Volume volume-c0e93621-1726-4791-93ba-ac810492591d (c0e93621-1726-4791-93ba-ac810492591d): created successfully Jul 07 08:20:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585a77f4-9711-467c-a775-e18034232431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Flow 'volume_create_manager' (fbfdd5c5-8db0-437c-943c-b47d6034b5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:28 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e06706e7-b1b3-4d4b-9d49-ac21ec5be120 tempest-ProjectReaderTests-2012969327 None] Created volume successfully. Jul 07 08:20:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Acquiring lock "cinder-c0e93621-1726-4791-93ba-ac810492591d-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Lock "cinder-c0e93621-1726-4791-93ba-ac810492591d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Acquiring lock "cinder-quobyte-c0e93621-1726-4791-93ba-ac810492591d" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Lock "cinder-quobyte-c0e93621-1726-4791-93ba-ac810492591d" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:30 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a632cdd-1af4-4842-acea-b123963e341a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:30 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d Jul 07 08:20:30 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:30 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d" returned: 0 in 0.866s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:30 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d Jul 07 08:20:30 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:31 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c0e93621-1726-4791-93ba-ac810492591d" returned: 0 in 0.721s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Lock "cinder-quobyte-c0e93621-1726-4791-93ba-ac810492591d" released by "delete_volume" :: held 1.654s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:31 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Created reservations ['be515c8f-7cf4-4cbc-9f88-ad08283d0154', 'c4acfaac-01e0-40b3-b9d6-6c1f3ce3fa62', '730eacc2-7f58-480d-8bd9-c1799e6a5d31', '65fb8244-7765-432e-b089-7301e119c73e'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:31 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:31 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:32 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-f53b6db6-8de7-40e0-bb2c-e6c6d2ce1be4 req-74daf079-9c2d-438f-bbd6-938cf4119cf9 tempest-AttachVolumeShelveTestJSON-1678255963 None] No connector for attachment a885b1cd-38ed-4c17-b458-5c89da5255d0; skipping storage backend terminate_connection call. {{(pid=87179) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 08:20:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-f53b6db6-8de7-40e0-bb2c-e6c6d2ce1be4 req-74daf079-9c2d-438f-bbd6-938cf4119cf9 tempest-AttachVolumeShelveTestJSON-1678255963 None] Deleting attachment a885b1cd-38ed-4c17-b458-5c89da5255d0. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:20:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.927s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:32 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:32 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Deleted volume successfully. Jul 07 08:20:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa3b7298-765f-413e-aace-bd4ea949984d tempest-ProjectReaderTests-2012969327 None] Lock "cinder-c0e93621-1726-4791-93ba-ac810492591d-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:32 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Flow 'volume_create_manager' (a70f62b6-cfe0-496a-a290-dcaa661d0e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef9dd8c-524b-4e23-bac4-bf552199ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef9dd8c-524b-4e23-bac4-bf552199ecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656053180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45204cd-fcd0-418b-ad8f-3d8f6cc604f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d586ac3f943544e49c424b95c01395ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:33Z,use_quota=True,user_id='d7a110df45df4ab781fbb02f271bb9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933bbcfd-578f-44ef-b34f-936cc4122ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933bbcfd-578f-44ef-b34f-936cc4122ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6e5c07-97a9-4d1f-9935-9b75977bbd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6e5c07-97a9-4d1f-9935-9b75977bbd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b45204cd-fcd0-418b-ad8f-3d8f6cc604f7', 'volume_name': 'volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840e0378-7bf4-4eaf-87e6-024ba1234864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840e0378-7bf4-4eaf-87e6-024ba1234864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96dad51-055d-41f6-89e5-7945355a434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Volume b45204cd-fcd0-418b-ad8f-3d8f6cc604f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7', 'volume_size': 1} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656053180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45204cd-fcd0-418b-ad8f-3d8f6cc604f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d586ac3f943544e49c424b95c01395ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:33Z,use_quota=True,user_id='d7a110df45df4ab781fbb02f271bb9bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Creating volume b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:33 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:33 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 1073741824 Jul 07 08:20:33 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:34 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 1073741824" returned: 0 in 1.099s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:34 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 Jul 07 08:20:34 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:35 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7" returned: 0 in 0.892s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.329s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96dad51-055d-41f6-89e5-7945355a434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d24f797-a026-4dfd-b37d-1dd8315a1d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1d8dd6-f2f6-4b4a-9d3e-e38b5e4d31c2]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Volume volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 (b45204cd-fcd0-418b-ad8f-3d8f6cc604f7): created successfully Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d24f797-a026-4dfd-b37d-1dd8315a1d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Flow 'volume_create_manager' (a70f62b6-cfe0-496a-a290-dcaa661d0e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:35 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5ca9cb8c-4086-4f2b-80e7-7c83845721d3 tempest-ProjectReaderTests-2012969327 None] Created volume successfully. Jul 07 08:20:35 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:20:35 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Acquiring lock "cinder-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Lock "cinder-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:36 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 0 in 1.000s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Acquiring lock "cinder-quobyte-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Lock "cinder-quobyte-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[56734274-1c58-4877-9597-e40f8a4ed0c2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:36 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:20:36 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:36 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 Jul 07 08:20:36 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:37 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 1 in 0.957s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.021s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:37 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7" returned: 0 in 0.880s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-5014d5d6-f913-4466-8ec9-019c7f895340', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b5462a5-b2f3-4b33-a1a8-313d693c5b1a', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:20:37 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7 Jul 07 08:20:37 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:37 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-cdb0c4ed-9061-4313-9040-7fc65efc5343 req-23192d28-abd7-411d-9941-1e18eebbb198 tempest-TestShelveInstance-1136546494 None] attachment_update completed successfully. Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "cinder-8c905a5d-eb04-4095-b026-d179ecaa0428-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-8c905a5d-eb04-4095-b026-d179ecaa0428-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "cinder-quobyte-8c905a5d-eb04-4095-b026-d179ecaa0428" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-quobyte-8c905a5d-eb04-4095-b026-d179ecaa0428" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[456ed1fd-ec64-4e5d-b9e2-4bece9b55fdd]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:37 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7" returned: 0 in 0.826s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Lock "cinder-quobyte-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7" released by "delete_volume" :: held 1.759s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:38 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 Jul 07 08:20:38 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Created reservations ['4d53e460-c4c2-414b-8a34-cc784ba0609a', '894e2e36-844d-48ea-907d-91ebd24591d8', 'a24176f8-afe8-4440-8fff-a1bdbf47f474', '473c4b9c-4934-47f4-99d7-980ae6e9c040'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:38 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:38 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:38 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428" returned: 0 in 0.943s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:38 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428 Jul 07 08:20:38 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:38 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.774s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Deleted volume successfully. Jul 07 08:20:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-521a54cd-0c48-433f-8efc-1c33d7e96f28 tempest-ProjectReaderTests-2012969327 None] Lock "cinder-b45204cd-fcd0-418b-ad8f-3d8f6cc604f7-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:39 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8c905a5d-eb04-4095-b026-d179ecaa0428" returned: 0 in 0.779s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-quobyte-8c905a5d-eb04-4095-b026-d179ecaa0428" released by "delete_volume" :: held 1.796s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:39 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Created reservations ['ffe41c48-6407-4e02-ada2-ca5180c12d45', '1e0185d4-ed09-4da2-880b-d4123a406191', '4d37adbb-dbf3-40aa-9dde-0cbaeb6773f7', '5a781e1d-b383-497f-844c-2329a61218e9'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:39 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:39 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "cinder-0bf2d3dd-8286-4e95-84a6-84481434ae49-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-0bf2d3dd-8286-4e95-84a6-84481434ae49-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=111,cinder:SELECT=91,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "cinder-quobyte-0bf2d3dd-8286-4e95-84a6-84481434ae49" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-quobyte-0bf2d3dd-8286-4e95-84a6-84481434ae49" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9486719-5994-4a1f-944d-1b8a13d70659]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:40 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 Jul 07 08:20:40 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:40 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.816s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:40 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Deleted volume successfully. Jul 07 08:20:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2761b8ee-c4b0-42c0-8d87-217335dbcc4d tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-8c905a5d-eb04-4095-b026-d179ecaa0428-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:41 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49" returned: 0 in 1.271s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:41 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49 Jul 07 08:20:41 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:42 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0bf2d3dd-8286-4e95-84a6-84481434ae49" returned: 0 in 0.954s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-quobyte-0bf2d3dd-8286-4e95-84a6-84481434ae49" released by "delete_volume" :: held 2.276s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:42 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Created reservations ['e70cb730-1257-4f0b-83b8-2c8db24f86f4', 'af2af773-fb32-4653-84e8-647914a962c7', 'ae10e6be-9442-48bb-b983-a85f466280a4', 'a1a06ab8-e8bf-4615-84aa-a30842cf071c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:42 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:42 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "cinder-77fc2ed9-aff0-4024-b58b-0df55244d600-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-77fc2ed9-aff0-4024-b58b-0df55244d600-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:43 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Flow 'volume_create_manager' (2c1c806f-9897-41a5-b173-02ede75f44a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe586f0-5a9c-4619-a037-4f75604a4bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.190s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Deleted volume successfully. Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe586f0-5a9c-4619-a037-4f75604a4bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977353901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfea0cd7-5d05-4ca6-9299-261f193e5ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04852e39c9d64075b1951a3ca21baedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:44Z,use_quota=True,user_id='1d9f5765207d44019c5f0000ee029b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95cce44-b048-4ebf-a91d-4e5365da6324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95cce44-b048-4ebf-a91d-4e5365da6324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d706665d-684c-4ad9-a4a4-43d3ed76e072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d706665d-684c-4ad9-a4a4-43d3ed76e072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfea0cd7-5d05-4ca6-9299-261f193e5ca1', 'volume_name': 'volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceb83db-abd9-4d89-a57c-68a91687154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceb83db-abd9-4d89-a57c-68a91687154f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196d887d-6adc-4f82-824b-910f45fe2664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:43 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Volume cfea0cd7-5d05-4ca6-9299-261f193e5ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1', 'volume_size': 1} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977353901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfea0cd7-5d05-4ca6-9299-261f193e5ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04852e39c9d64075b1951a3ca21baedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:44Z,use_quota=True,user_id='1d9f5765207d44019c5f0000ee029b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Creating volume cfea0cd7-5d05-4ca6-9299-261f193e5ca1 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:43 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:20:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "cinder-quobyte-77fc2ed9-aff0-4024-b58b-0df55244d600" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:44 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 1073741824 Jul 07 08:20:44 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-quobyte-77fc2ed9-aff0-4024-b58b-0df55244d600" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fe3a8d67-4b50-4237-b42b-76d0d5fedfe8 tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-0bf2d3dd-8286-4e95-84a6-84481434ae49-delete_volume" released by "delete_volume" :: held 3.911s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e728bcda-75a5-45e4-acbf-4ad58c874168]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:44 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 Jul 07 08:20:44 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:45 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 1073741824" returned: 0 in 1.252s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:45 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 Jul 07 08:20:45 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:45 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600" returned: 0 in 1.841s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:45 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600 Jul 07 08:20:45 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:46 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-77fc2ed9-aff0-4024-b58b-0df55244d600" returned: 0 in 0.865s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-quobyte-77fc2ed9-aff0-4024-b58b-0df55244d600" released by "delete_volume" :: held 2.790s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:46 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Created reservations ['6a140531-23c3-4343-8f4d-ebf07b8a7b41', '36a196c7-8309-4998-b89d-1e9cd9f5e508', '07870215-5795-4014-845a-e638f21e8e58', 'c57e18cf-3110-40cc-a7d0-ddcca4f838e4'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:47 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:47 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:47 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1" returned: 0 in 1.844s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] <== create_volume: return (3213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.215s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196d887d-6adc-4f82-824b-910f45fe2664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ea2a0c-4264-4e4d-ae57-5afe7fa6f60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:47 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Volume volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 (cfea0cd7-5d05-4ca6-9299-261f193e5ca1): created successfully Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ea2a0c-4264-4e4d-ae57-5afe7fa6f60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Flow 'volume_create_manager' (2c1c806f-9897-41a5-b173-02ede75f44a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ff212720-1b37-41d8-815b-d515788da1d8 tempest-ProjectReaderTests-2027141060 None] Created volume successfully. Jul 07 08:20:48 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.194s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:48 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:48 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Deleted volume successfully. Jul 07 08:20:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aad48878-c96b-49a6-8144-d0586d142025 tempest-AttachVolumeTestJSON-1912319260 None] Lock "cinder-77fc2ed9-aff0-4024-b58b-0df55244d600-delete_volume" released by "delete_volume" :: held 4.580s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "cinder-cfea0cd7-5d05-4ca6-9299-261f193e5ca1-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-cfea0cd7-5d05-4ca6-9299-261f193e5ca1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "cinder-quobyte-cfea0cd7-5d05-4ca6-9299-261f193e5ca1" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-quobyte-cfea0cd7-5d05-4ca6-9299-261f193e5ca1" acquired by "delete_volume" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:48 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[11de139f-e6d8-4129-853e-961c4b7a0cc0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:48 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 Jul 07 08:20:48 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:50 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1" returned: 0 in 1.522s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:50 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1 Jul 07 08:20:50 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:51 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cfea0cd7-5d05-4ca6-9299-261f193e5ca1" returned: 0 in 1.063s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-quobyte-cfea0cd7-5d05-4ca6-9299-261f193e5ca1" released by "delete_volume" :: held 2.650s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:51 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Created reservations ['be754b59-7588-4b50-98ad-0bf5a0592856', '0b680454-a00c-4fc4-a3de-5d37a43f22da', 'b7a3926e-27e3-430d-94e2-791adead2f6d', '2c28800f-8597-479e-8750-c7b1678d5f98'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:51 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:51 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:52 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.451s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:52 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:20:53 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Deleted volume successfully. Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Flow 'volume_create_manager' (e0d82072-4a9a-4a7e-ac42-b11af0d40692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa1b743-8ba9-428b-abfe-c20f71c33c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa1b743-8ba9-428b-abfe-c20f71c33c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356830384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6536db-96a4-4197-807b-491ad0694de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04852e39c9d64075b1951a3ca21baedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:53Z,use_quota=True,user_id='1d9f5765207d44019c5f0000ee029b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167eb81e-17ac-4fcd-aded-95f8258a8fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167eb81e-17ac-4fcd-aded-95f8258a8fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e114683a-6194-4dc5-b205-8bad24753f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e114683a-6194-4dc5-b205-8bad24753f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6536db-96a4-4197-807b-491ad0694de3', 'volume_name': 'volume-ef6536db-96a4-4197-807b-491ad0694de3', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960a9486-bd4c-410b-9199-f68acf133c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960a9486-bd4c-410b-9199-f68acf133c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9551c8-9831-4dba-8adf-9979b7926f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:53 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Volume ef6536db-96a4-4197-807b-491ad0694de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6536db-96a4-4197-807b-491ad0694de3', 'volume_size': 1} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356830384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6536db-96a4-4197-807b-491ad0694de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04852e39c9d64075b1951a3ca21baedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:20:53Z,use_quota=True,user_id='1d9f5765207d44019c5f0000ee029b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Creating volume ef6536db-96a4-4197-807b-491ad0694de3 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:20:53 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-06bce2e0-81b9-4af2-9b70-ac39e3fecdb9 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-cfea0cd7-5d05-4ca6-9299-261f193e5ca1-delete_volume" released by "delete_volume" :: held 4.569s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:53 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3 1073741824 Jul 07 08:20:53 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:54 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3 1073741824" returned: 0 in 1.322s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:54 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3 Jul 07 08:20:54 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:55 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3" returned: 0 in 1.368s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] <== create_volume: return (2760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:20:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.765s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9551c8-9831-4dba-8adf-9979b7926f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6536db-96a4-4197-807b-491ad0694de3', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45f434b-e7f5-4185-9189-a4d14d94f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:20:55 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Volume volume-ef6536db-96a4-4197-807b-491ad0694de3 (ef6536db-96a4-4197-807b-491ad0694de3): created successfully Jul 07 08:20:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45f434b-e7f5-4185-9189-a4d14d94f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:20:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Flow 'volume_create_manager' (e0d82072-4a9a-4a7e-ac42-b11af0d40692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:20:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-541f8998-c184-481a-8c11-1002c1d7131b tempest-ProjectReaderTests-2027141060 None] Created volume successfully. Jul 07 08:20:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "cinder-ef6536db-96a4-4197-807b-491ad0694de3-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-ef6536db-96a4-4197-807b-491ad0694de3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "cinder-quobyte-ef6536db-96a4-4197-807b-491ad0694de3" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:20:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-quobyte-ef6536db-96a4-4197-807b-491ad0694de3" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:20:56 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0197a36-c881-41a0-bcc9-74ff42b66caf]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:20:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:56 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3 Jul 07 08:20:56 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:57 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3" returned: 0 in 1.376s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:57 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3 Jul 07 08:20:57 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:20:59 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 07 08:20:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef6536db-96a4-4197-807b-491ad0694de3" returned: 0 in 1.305s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:20:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-quobyte-ef6536db-96a4-4197-807b-491ad0694de3" released by "delete_volume" :: held 2.747s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:20:59 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Created reservations ['4963f1b7-b3d9-4dcc-aa9a-4d0a7d8f80e0', '3cc6bcef-733f-48fb-80a3-7e0b24733d65', '0a5d21a9-7081-457d-b9bb-ae09801ab52e', '2913adb9-250b-4d71-8028-4b9bcc45d4a8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:20:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:20:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:20:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:20:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:20:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:20:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:20:59 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:20:59 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Flow 'volume_create_manager' (36c8942d-4229-4faa-9a01-f79072e19cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce91901c-4f6c-402f-9b1d-7624191da089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce91901c-4f6c-402f-9b1d-7624191da089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844328487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6412f4-452f-4f13-9225-f1eeaf425028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04852e39c9d64075b1951a3ca21baedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:00Z,use_quota=True,user_id='1d9f5765207d44019c5f0000ee029b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263d6a9a-ab62-4d44-90e2-ea8fdc486121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263d6a9a-ab62-4d44-90e2-ea8fdc486121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986d898b-d70c-4e5f-8ad4-1ec5566fc036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986d898b-d70c-4e5f-8ad4-1ec5566fc036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6412f4-452f-4f13-9225-f1eeaf425028', 'volume_name': 'volume-2f6412f4-452f-4f13-9225-f1eeaf425028', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a35ac7-eb1a-467c-9fb7-7d9f937b844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a35ac7-eb1a-467c-9fb7-7d9f937b844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383fa513-a9f7-4985-9f35-5c8af3395161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:00 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Volume 2f6412f4-452f-4f13-9225-f1eeaf425028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6412f4-452f-4f13-9225-f1eeaf425028', 'volume_size': 1} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844328487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6412f4-452f-4f13-9225-f1eeaf425028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04852e39c9d64075b1951a3ca21baedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:00Z,use_quota=True,user_id='1d9f5765207d44019c5f0000ee029b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Creating volume 2f6412f4-452f-4f13-9225-f1eeaf425028 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:00 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:00 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028 1073741824 Jul 07 08:21:00 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:00 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.351s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:00 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Deleted volume successfully. Jul 07 08:21:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d8eecc2d-f679-4f1a-92e2-44c992178d83 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-ef6536db-96a4-4197-807b-491ad0694de3-delete_volume" released by "delete_volume" :: held 4.480s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:01 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028 1073741824" returned: 0 in 1.330s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:02 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028 Jul 07 08:21:02 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:02 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028" returned: 0 in 0.854s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:21:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383fa513-a9f7-4985-9f35-5c8af3395161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6412f4-452f-4f13-9225-f1eeaf425028', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0360a62-6923-4d7d-a32b-c32f6d976756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:02 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Volume volume-2f6412f4-452f-4f13-9225-f1eeaf425028 (2f6412f4-452f-4f13-9225-f1eeaf425028): created successfully Jul 07 08:21:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0360a62-6923-4d7d-a32b-c32f6d976756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Flow 'volume_create_manager' (36c8942d-4229-4faa-9a01-f79072e19cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:02 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9829a4a2-31f2-40c1-a2c8-4027e12732c6 tempest-ProjectReaderTests-2027141060 None] Created volume successfully. Jul 07 08:21:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "cinder-2f6412f4-452f-4f13-9225-f1eeaf425028-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-2f6412f4-452f-4f13-9225-f1eeaf425028-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "cinder-quobyte-2f6412f4-452f-4f13-9225-f1eeaf425028" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-quobyte-2f6412f4-452f-4f13-9225-f1eeaf425028" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:03 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[06780efb-1c6f-433f-91f4-8b8804a6e94f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:04 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028 Jul 07 08:21:04 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:21:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:04 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:21:04 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:05 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028" returned: 0 in 1.097s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:05 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028 Jul 07 08:21:05 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:05 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.979s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:21:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:21:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:21:06 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2f6412f4-452f-4f13-9225-f1eeaf425028" returned: 0 in 1.016s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-quobyte-2f6412f4-452f-4f13-9225-f1eeaf425028" released by "delete_volume" :: held 2.165s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Created reservations ['70edd5c0-7b79-43e3-ae62-0a0827ad99a5', '05a47f7e-fb19-4c4e-aa94-1cf47db93bb7', '1761c4b9-5cc3-49d2-aeb1-14765c0e2a24', 'cf8a2f7b-59cd-41f7-89de-4f890283950b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:06 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:21:06 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:06 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.725s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:06 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Deleted volume successfully. Jul 07 08:21:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a1f38967-3ae6-46f1-a2c7-8efc0dd6b091 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-2f6412f4-452f-4f13-9225-f1eeaf425028-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Flow 'volume_create_manager' (018b3175-a3d7-4b54-b87c-52c33b648514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc9d683-88bf-4dd1-8409-77b8ef1d8072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc9d683-88bf-4dd1-8409-77b8ef1d8072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707036589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04852e39c9d64075b1951a3ca21baedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:08Z,use_quota=True,user_id='1d9f5765207d44019c5f0000ee029b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e589af-e66c-45c4-9277-02776973cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e589af-e66c-45c4-9277-02776973cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eca8a0c-10cd-4839-82c4-d0535da360c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eca8a0c-10cd-4839-82c4-d0535da360c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9', 'volume_name': 'volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23bf2d2-af50-4022-ac1a-dcc48fad4165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23bf2d2-af50-4022-ac1a-dcc48fad4165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346696ce-d62e-4f1d-ab3e-b0187bd67742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:08 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Volume b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9', 'volume_size': 1} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707036589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04852e39c9d64075b1951a3ca21baedd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:08Z,use_quota=True,user_id='1d9f5765207d44019c5f0000ee029b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Creating volume b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:08 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:21:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:08 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 1073741824 Jul 07 08:21:08 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:09 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 1073741824" returned: 0 in 1.022s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:09 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 Jul 07 08:21:09 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:10 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9" returned: 0 in 0.889s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:21:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346696ce-d62e-4f1d-ab3e-b0187bd67742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf68198d-bc90-4f1b-af40-e1b2064c2333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:10 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Volume volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 (b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9): created successfully Jul 07 08:21:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf68198d-bc90-4f1b-af40-e1b2064c2333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Flow 'volume_create_manager' (018b3175-a3d7-4b54-b87c-52c33b648514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-db412d0a-17b1-4a4c-af24-1ccf65c9f052 tempest-ProjectReaderTests-2027141060 None] Created volume successfully. Jul 07 08:21:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "cinder-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "cinder-quobyte-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-quobyte-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:11 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[83425fd1-d056-4cce-a2a3-8f42fb5f5a8d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:11 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 Jul 07 08:21:11 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:12 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9" returned: 0 in 0.861s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:12 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9 Jul 07 08:21:12 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:12 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9" returned: 0 in 0.735s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-quobyte-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9" released by "delete_volume" :: held 1.644s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Created reservations ['d2696aa0-7175-464b-babf-52439839293c', '845110f2-eec7-4ebc-8a2a-643ec68c1b21', '47512a81-c763-4b70-b470-4cee49ac8b88', 'daf2ef4a-217d-41c3-9b83-eea1c549f6c6'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:13 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:21:13 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:13 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Deleted volume successfully. Jul 07 08:21:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-08829880-747f-40c6-a70a-c8a8572283b3 tempest-ProjectReaderTests-2027141060 None] Lock "cinder-b6f121a1-35f0-4b3d-bdf5-7fbccd0939c9-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:19 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-e6d6e334-fa93-4897-a02d-d32e7ac3d86f req-d49ef38c-cda2-4d70-8175-9ede92dab22b tempest-TestShelveInstance-1136546494 None] Terminate volume connection completed successfully. Jul 07 08:21:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-e6d6e334-fa93-4897-a02d-d32e7ac3d86f req-d49ef38c-cda2-4d70-8175-9ede92dab22b tempest-TestShelveInstance-1136546494 None] Deleting attachment 2b5462a5-b2f3-4b33-a1a8-313d693c5b1a. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:21:23 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:DELETE=7,cinder:SELECT=37,cinder:INSERT=16,cinder:UPDATE=59 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:21:23 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:INSERT=25,cinder:UPDATE=96,cinder:SELECT=78,cinder:DELETE=8 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:21:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b99f96-c2dd-4699-8a0c-d523f5b65e2c]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:24 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:21:24 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:24 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 0 in 0.773s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:24 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:21:24 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:25 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 1 in 0.740s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:21:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.551s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-5014d5d6-f913-4466-8ec9-019c7f895340', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46587327-cf3a-4aa5-bf11-22b51b358d9d', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:21:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-569fdc47-855d-4e74-b430-8dd76d29a919 req-54844518-e79b-4157-be96-dd73e70b9b09 tempest-TestShelveInstance-1136546494 None] attachment_update completed successfully. Jul 07 08:21:37 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:21:37 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:21:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Acquiring lock "cinder-4d584da7-e126-4c8d-9d85-8cd76772ec50-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "cinder-4d584da7-e126-4c8d-9d85-8cd76772ec50-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Acquiring lock "cinder-quobyte-4d584da7-e126-4c8d-9d85-8cd76772ec50" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:21:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "cinder-quobyte-4d584da7-e126-4c8d-9d85-8cd76772ec50" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:21:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f94ef61-98bc-42a3-a42a-709266f35bf5]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:44 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 Jul 07 08:21:44 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:44 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50" returned: 0 in 0.821s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:44 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50 Jul 07 08:21:44 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:45 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d584da7-e126-4c8d-9d85-8cd76772ec50" returned: 0 in 0.643s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "cinder-quobyte-4d584da7-e126-4c8d-9d85-8cd76772ec50" released by "delete_volume" :: held 1.517s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:45 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Created reservations ['f7f787c6-ff64-4af8-b910-e2998bb769b8', '43a9b417-8d5c-4c90-9c96-76af06312aa9', '6e1ba184-ea42-484b-9e56-318f4a866c92', '9552045f-085b-4170-8a6d-76638c875a3c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:21:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:45 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:21:45 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:46 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.721s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:46 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:21:46 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Deleted volume successfully. Jul 07 08:21:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e147a86d-c6ce-4c10-9f07-f6c4a63d4f61 tempest-AttachVolumeShelveTestJSON-1678255963 None] Lock "cinder-4d584da7-e126-4c8d-9d85-8cd76772ec50-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Flow 'volume_create_manager' (6547d01b-ccd5-405b-9aa4-e89e39af2360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d5777e-27c4-4e42-92fc-75961347c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d5777e-27c4-4e42-92fc-75961347c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2104269600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d6189f-a54b-4911-bb37-53447e55353f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5ffc01a9b34514862ece8528f37ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:52Z,use_quota=True,user_id='32c4703bd1284fcda9977bfb426af94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7312f9-f723-4524-8590-41e018d45e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7312f9-f723-4524-8590-41e018d45e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2cfc1c-422d-4b81-9109-9ad2edc4f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2cfc1c-422d-4b81-9109-9ad2edc4f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d6189f-a54b-4911-bb37-53447e55353f', 'volume_name': 'volume-f7d6189f-a54b-4911-bb37-53447e55353f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcbc0fb-3689-4144-82b7-b32ce809cbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcbc0fb-3689-4144-82b7-b32ce809cbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfee3b4-fe85-41e1-b5cb-62c4cb078fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:52 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Volume f7d6189f-a54b-4911-bb37-53447e55353f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d6189f-a54b-4911-bb37-53447e55353f', 'volume_size': 1} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2104269600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d6189f-a54b-4911-bb37-53447e55353f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5ffc01a9b34514862ece8528f37ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:21:52Z,use_quota=True,user_id='32c4703bd1284fcda9977bfb426af94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Creating volume f7d6189f-a54b-4911-bb37-53447e55353f {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:21:52 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:21:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:52 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f 1073741824 Jul 07 08:21:52 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:53 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f 1073741824" returned: 0 in 0.865s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:53 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f Jul 07 08:21:53 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:54 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f" returned: 0 in 0.641s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:21:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfee3b4-fe85-41e1-b5cb-62c4cb078fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d6189f-a54b-4911-bb37-53447e55353f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bad0c6f-fe96-4619-879f-dc53ca56fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:21:54 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Volume volume-f7d6189f-a54b-4911-bb37-53447e55353f (f7d6189f-a54b-4911-bb37-53447e55353f): created successfully Jul 07 08:21:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bad0c6f-fe96-4619-879f-dc53ca56fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:21:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Flow 'volume_create_manager' (6547d01b-ccd5-405b-9aa4-e89e39af2360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:21:54 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d07301fb-3cba-43a8-8f46-b063b0896b8d tempest-AttachVolumeNegativeTest-1177918499 None] Created volume successfully. Jul 07 08:21:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-47955330-7db0-4268-9027-1a26c7a24f15 req-d7436d3f-8b76-40c7-8c0b-b1fe8ea88dd3 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:21:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-47955330-7db0-4268-9027-1a26c7a24f15 req-d7436d3f-8b76-40c7-8c0b-b1fe8ea88dd3 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:21:57 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3efd41a-57fd-43d2-923e-2b9f0f585f33]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:21:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-47955330-7db0-4268-9027-1a26c7a24f15 req-d7436d3f-8b76-40c7-8c0b-b1fe8ea88dd3 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:21:57 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f Jul 07 08:21:57 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:21:58 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 07 08:21:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-47955330-7db0-4268-9027-1a26c7a24f15 req-d7436d3f-8b76-40c7-8c0b-b1fe8ea88dd3 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f" returned: 0 in 0.784s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:21:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-47955330-7db0-4268-9027-1a26c7a24f15 req-d7436d3f-8b76-40c7-8c0b-b1fe8ea88dd3 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.802s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:21:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-47955330-7db0-4268-9027-1a26c7a24f15 req-d7436d3f-8b76-40c7-8c0b-b1fe8ea88dd3 tempest-AttachVolumeNegativeTest-1177918499 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-f7d6189f-a54b-4911-bb37-53447e55353f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a051454-5420-4a8a-968f-0d8abf861b9f', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:21:58 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-47955330-7db0-4268-9027-1a26c7a24f15 req-d7436d3f-8b76-40c7-8c0b-b1fe8ea88dd3 tempest-AttachVolumeNegativeTest-1177918499 None] attachment_update completed successfully. Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Flow 'volume_create_manager' (1d259dd0-0ddd-464f-8e64-cd0f672641e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865965db-d86b-4677-bd52-d0fc8ce80639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865965db-d86b-4677-bd52-d0fc8ce80639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-60693732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd237a5-d8fe-421d-a366-615a7bad3ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af5903d9478495289afadf052f29fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:04Z,use_quota=True,user_id='e611c2105ee94b75b8ee8c7cbef95b57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae81f28-5b5e-4b50-8486-fc016a611b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae81f28-5b5e-4b50-8486-fc016a611b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ac6bc0-2eb2-4e48-8cc1-4273b6321ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ac6bc0-2eb2-4e48-8cc1-4273b6321ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd237a5-d8fe-421d-a366-615a7bad3ae1', 'volume_name': 'volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82d2d43-b8bb-476c-956a-214b02f4cd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82d2d43-b8bb-476c-956a-214b02f4cd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df83ac22-789c-4b18-8f20-20fb2a8c5f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:04 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Volume 7cd237a5-d8fe-421d-a366-615a7bad3ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1', 'volume_size': 1} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-60693732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd237a5-d8fe-421d-a366-615a7bad3ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af5903d9478495289afadf052f29fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:04Z,use_quota=True,user_id='e611c2105ee94b75b8ee8c7cbef95b57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Creating volume 7cd237a5-d8fe-421d-a366-615a7bad3ae1 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:04 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:04 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 1073741824 Jul 07 08:22:04 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:04 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:22:04 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:05 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 1073741824" returned: 0 in 0.928s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:05 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 Jul 07 08:22:05 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:05 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.725s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:22:05 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1" returned: 0 in 0.639s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df83ac22-789c-4b18-8f20-20fb2a8c5f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf26ffd-26e9-4a61-b090-385308505749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:05 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Volume volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 (7cd237a5-d8fe-421d-a366-615a7bad3ae1): created successfully Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf26ffd-26e9-4a61-b090-385308505749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Flow 'volume_create_manager' (1d259dd0-0ddd-464f-8e64-cd0f672641e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:05 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-846f63b8-8dd3-42fd-8f7b-55b4a33bce22 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Created volume successfully. Jul 07 08:22:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Acquiring lock "cinder-7cd237a5-d8fe-421d-a366-615a7bad3ae1-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "cinder-7cd237a5-d8fe-421d-a366-615a7bad3ae1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Acquiring lock "cinder-quobyte-7cd237a5-d8fe-421d-a366-615a7bad3ae1" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "cinder-quobyte-7cd237a5-d8fe-421d-a366-615a7bad3ae1" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:07 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf87697-50ee-4b8f-bf0c-38cbeb9c609e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:07 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 Jul 07 08:22:07 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:07 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1" returned: 0 in 0.777s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:07 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1 Jul 07 08:22:07 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:08 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7cd237a5-d8fe-421d-a366-615a7bad3ae1" returned: 0 in 0.632s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "cinder-quobyte-7cd237a5-d8fe-421d-a366-615a7bad3ae1" released by "delete_volume" :: held 1.448s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:08 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Created reservations ['082a3a95-2d0f-4808-b30c-e5d778867fd7', '8cb450f9-2d0a-4e13-94f6-0fe6e2fe440a', '139594f3-1477-4a30-9f35-013a8784c161', '3da6766c-2d2d-4647-8e7a-955f9a39c358'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:08 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:22:08 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:09 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.680s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:09 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:09 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Deleted volume successfully. Jul 07 08:22:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c82bab70-a6b7-4800-b232-4cabe14046f8 tempest-VolumeQuotasNegativeTestJSON-1543029702 None] Lock "cinder-7cd237a5-d8fe-421d-a366-615a7bad3ae1-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:18 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=21,cinder:INSERT=4,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:22:19 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=23,cinder:SELECT=18,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:22:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-90e2a7da-5373-4363-a7fd-86506e9277da tempest-TestShelveInstance-1136546494 None] Terminate volume connection completed successfully. Jul 07 08:22:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-90e2a7da-5373-4363-a7fd-86506e9277da tempest-TestShelveInstance-1136546494 None] Deleting attachment 46587327-cf3a-4aa5-bf11-22b51b358d9d. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:22:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Acquiring lock "cinder-5014d5d6-f913-4466-8ec9-019c7f895340-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Lock "cinder-5014d5d6-f913-4466-8ec9-019c7f895340-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Acquiring lock "cinder-quobyte-5014d5d6-f913-4466-8ec9-019c7f895340" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Lock "cinder-quobyte-5014d5d6-f913-4466-8ec9-019c7f895340" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:22 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6426d234-108d-4d8b-ad8e-da064505066b]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:22 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:22:22 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:24 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 0 in 1.284s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:24 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:22:24 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:24 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 1 in 0.923s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:22:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:25 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340 Jul 07 08:22:25 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:25 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5014d5d6-f913-4466-8ec9-019c7f895340" returned: 0 in 0.854s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Lock "cinder-quobyte-5014d5d6-f913-4466-8ec9-019c7f895340" released by "delete_volume" :: held 3.170s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:25 devstack cinder-volume[87179]: DEBUG cinder.quota [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Created reservations ['99bab855-58ff-46b6-b54c-e272496e6117', 'db7dd429-d38d-4298-b2c8-c6925d59fc01', '37db5e40-8f66-44cb-bbfb-de9818a9ccb7', 'ebfd959d-f98b-4ffb-a591-596394eb69b8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:26 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:22:26 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:26 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.846s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:26 devstack cinder-volume[87179]: DEBUG cinder.manager [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:22:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Deleted volume successfully. Jul 07 08:22:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [req-db1db507-8f91-4f8b-8b33-5e0cb1252943 req-d4d53c4b-06e6-4e20-9b89-05c61eac98f3 tempest-TestShelveInstance-1136546494 None] Lock "cinder-5014d5d6-f913-4466-8ec9-019c7f895340-delete_volume" released by "delete_volume" :: held 4.298s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:35 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:22:36 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (4e943650-5bb7-43a7-9563-e816d66cd49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a67dfd6-fbc1-45c6-b203-9bb0842d287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a67dfd6-fbc1-45c6-b203-9bb0842d287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678091133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e526a8-ae67-4b8d-ba4c-e291579a4b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:45Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c636ad48-8c57-40cf-8c2e-3237650dfa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c636ad48-8c57-40cf-8c2e-3237650dfa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0757f8-bcf6-463a-a547-d3dbf220f098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0757f8-bcf6-463a-a547-d3dbf220f098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e526a8-ae67-4b8d-ba4c-e291579a4b89', 'volume_name': 'volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715aa931-74bf-4263-8a83-dc78581821c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715aa931-74bf-4263-8a83-dc78581821c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34bc909-6c20-4d0c-84c4-10d33ba8ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:44 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume 48e526a8-ae67-4b8d-ba4c-e291579a4b89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89', 'volume_size': 1} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678091133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e526a8-ae67-4b8d-ba4c-e291579a4b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:45Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Creating volume 48e526a8-ae67-4b8d-ba4c-e291579a4b89 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:44 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:22:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:44 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 1073741824 Jul 07 08:22:44 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:45 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 1073741824" returned: 0 in 1.044s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:45 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 Jul 07 08:22:45 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:46 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89" returned: 0 in 0.812s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34bc909-6c20-4d0c-84c4-10d33ba8ac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a027f2-f12a-459f-be91-1d858b02bd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:46 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 (48e526a8-ae67-4b8d-ba4c-e291579a4b89): created successfully Jul 07 08:22:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a027f2-f12a-459f-be91-1d858b02bd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (4e943650-5bb7-43a7-9563-e816d66cd49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:46 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e169c5c6-5376-428d-acf8-7f1be1cdf96d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created volume successfully. Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (b2530c27-afb7-404b-9d4b-d35058cf4f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b0fca1-83da-4b4a-96cf-934088538747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b0fca1-83da-4b4a-96cf-934088538747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1619566447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afd9e16-d8ac-4862-a63d-64048709bf1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:48Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5762f0-71c3-4992-84c7-0b004d3d28ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5762f0-71c3-4992-84c7-0b004d3d28ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d000322-3e7c-4388-9c00-5e69c3325855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d000322-3e7c-4388-9c00-5e69c3325855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7afd9e16-d8ac-4862-a63d-64048709bf1b', 'volume_name': 'volume-7afd9e16-d8ac-4862-a63d-64048709bf1b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcf81bd-dad7-452b-9b46-03b1bf9a20df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcf81bd-dad7-452b-9b46-03b1bf9a20df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdf8d88-cafd-47f6-a1a8-96a6ff7a0911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume 7afd9e16-d8ac-4862-a63d-64048709bf1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7afd9e16-d8ac-4862-a63d-64048709bf1b', 'volume_size': 1} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1619566447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afd9e16-d8ac-4862-a63d-64048709bf1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:48Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Creating volume 7afd9e16-d8ac-4862-a63d-64048709bf1b {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:48 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:48 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b 1073741824 Jul 07 08:22:48 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (c70974e2-20b7-4f51-a3b7-393cbb454143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1c52e6-de9f-46f8-b656-23a68fe8cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1c52e6-de9f-46f8-b656-23a68fe8cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357257062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72989079-fc96-4a32-8e0d-2cc6896bedbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:49Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e569547-9ee0-404f-886e-9055cc492bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e569547-9ee0-404f-886e-9055cc492bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679b4062-9078-4501-b5c8-6f44231ac8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679b4062-9078-4501-b5c8-6f44231ac8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72989079-fc96-4a32-8e0d-2cc6896bedbe', 'volume_name': 'volume-72989079-fc96-4a32-8e0d-2cc6896bedbe', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06bf446-217f-4d2b-99a4-2e81ceb78fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06bf446-217f-4d2b-99a4-2e81ceb78fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ca7bd2-d505-4397-b7df-191bd277f1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:48 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume 72989079-fc96-4a32-8e0d-2cc6896bedbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72989079-fc96-4a32-8e0d-2cc6896bedbe', 'volume_size': 1} Jul 07 08:22:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (028f3b02-8845-46b1-8f8a-b6c6eeb04569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a57840f-5316-4132-86b1-f4e12548fc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a57840f-5316-4132-86b1-f4e12548fc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1920727495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d33e4cd-7275-4d8c-b785-3ea5438bdcdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:49Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9619f50e-895d-4d1f-81b2-1d4ba3d1222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9619f50e-895d-4d1f-81b2-1d4ba3d1222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc21510-83a2-4ae0-baef-7ed5254a9636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc21510-83a2-4ae0-baef-7ed5254a9636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d33e4cd-7275-4d8c-b785-3ea5438bdcdd', 'volume_name': 'volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1787c471-f533-4630-9cb2-3b0d209196fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1787c471-f533-4630-9cb2-3b0d209196fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871bd02f-29a5-498a-8380-859b9a0e21dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume 5d33e4cd-7275-4d8c-b785-3ea5438bdcdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd', 'volume_size': 1} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:49 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b 1073741824" returned: 0 in 1.070s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:49 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b Jul 07 08:22:49 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (97a51742-92b6-4031-bcef-5446751dbb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11f30d9-e527-4dd8-aa90-1c9b1d5dc3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11f30d9-e527-4dd8-aa90-1c9b1d5dc3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182543146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987dde6e-5004-4088-a2be-bd63623d7e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:50Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8705558a-2788-4a66-a6b6-38bab7cc2925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8705558a-2788-4a66-a6b6-38bab7cc2925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aa6f84-8d83-43a6-82cd-97ca7f554620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aa6f84-8d83-43a6-82cd-97ca7f554620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987dde6e-5004-4088-a2be-bd63623d7e71', 'volume_name': 'volume-987dde6e-5004-4088-a2be-bd63623d7e71', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35354d3b-3d33-4753-951c-f9709df17474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35354d3b-3d33-4753-951c-f9709df17474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524735d3-a612-461b-bd7e-106e67bf81a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:49 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume 987dde6e-5004-4088-a2be-bd63623d7e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987dde6e-5004-4088-a2be-bd63623d7e71', 'volume_size': 1} Jul 07 08:22:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (17ed3131-eb73-41f4-8c95-e4fca9c2337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c3513-c18f-46ca-bc0d-291e38f79ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64c3513-c18f-46ca-bc0d-291e38f79ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306022906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9c51e5-dad6-4ccc-90df-abdeee561d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:50Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62870457-445a-4b5a-b07e-b9ce84ff225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62870457-445a-4b5a-b07e-b9ce84ff225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01606b66-661c-4b87-a663-17b44fd62fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01606b66-661c-4b87-a663-17b44fd62fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d9c51e5-dad6-4ccc-90df-abdeee561d3d', 'volume_name': 'volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8084e3d-dac2-458f-8075-b71989a08d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8084e3d-dac2-458f-8075-b71989a08d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1538e88a-eb95-4634-9a0b-55873495e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:50 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume 4d9c51e5-dad6-4ccc-90df-abdeee561d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d', 'volume_size': 1} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:50 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b" returned: 0 in 0.721s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.329s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357257062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72989079-fc96-4a32-8e0d-2cc6896bedbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:49Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Creating volume 72989079-fc96-4a32-8e0d-2cc6896bedbe {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:50 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdf8d88-cafd-47f6-a1a8-96a6ff7a0911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7afd9e16-d8ac-4862-a63d-64048709bf1b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:50 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe 1073741824 Jul 07 08:22:50 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f030aada-1452-4643-abdc-a195088a2f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:50 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume volume-7afd9e16-d8ac-4862-a63d-64048709bf1b (7afd9e16-d8ac-4862-a63d-64048709bf1b): created successfully Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f030aada-1452-4643-abdc-a195088a2f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (b2530c27-afb7-404b-9d4b-d35058cf4f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b00ba47e-c09f-4f89-afda-8e778754313f tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created volume successfully. Jul 07 08:22:51 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe 1073741824" returned: 0 in 0.907s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:51 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe Jul 07 08:22:51 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:51 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe" returned: 0 in 0.677s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.595s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1920727495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d33e4cd-7275-4d8c-b785-3ea5438bdcdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:49Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Creating volume 5d33e4cd-7275-4d8c-b785-3ea5438bdcdd {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:51 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ca7bd2-d505-4397-b7df-191bd277f1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72989079-fc96-4a32-8e0d-2cc6896bedbe', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:51 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd 1073741824 Jul 07 08:22:51 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec9ed1d-1354-4914-923d-25a9501dab8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:51 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume volume-72989079-fc96-4a32-8e0d-2cc6896bedbe (72989079-fc96-4a32-8e0d-2cc6896bedbe): created successfully Jul 07 08:22:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec9ed1d-1354-4914-923d-25a9501dab8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (c70974e2-20b7-4f51-a3b7-393cbb454143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b19a4fc6-a22b-4234-b3b8-986f02dc3bd0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created volume successfully. Jul 07 08:22:52 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd 1073741824" returned: 0 in 1.042s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:53 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd Jul 07 08:22:53 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:53 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd" returned: 0 in 0.685s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.042s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182543146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987dde6e-5004-4088-a2be-bd63623d7e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:50Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Creating volume 987dde6e-5004-4088-a2be-bd63623d7e71 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:53 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:53 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71 1073741824 Jul 07 08:22:53 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871bd02f-29a5-498a-8380-859b9a0e21dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefeaf5a-76af-4a49-bd4a-a23a680e5830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:53 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd (5d33e4cd-7275-4d8c-b785-3ea5438bdcdd): created successfully Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefeaf5a-76af-4a49-bd4a-a23a680e5830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (028f3b02-8845-46b1-8f8a-b6c6eeb04569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:53 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-25b2fad6-1aa0-4ef7-9fcb-ad5d4ef1798d tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created volume successfully. Jul 07 08:22:54 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71 1073741824" returned: 0 in 1.135s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:54 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71 Jul 07 08:22:54 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:55 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71" returned: 0 in 0.635s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.468s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306022906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9c51e5-dad6-4ccc-90df-abdeee561d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0935eec02645cc8795b27ee8ee9826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:22:50Z,use_quota=True,user_id='b9c96eedc01e4da3b55a2dbaf687b5bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Creating volume 4d9c51e5-dad6-4ccc-90df-abdeee561d3d {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:22:55 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:55 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d 1073741824 Jul 07 08:22:55 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524735d3-a612-461b-bd7e-106e67bf81a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987dde6e-5004-4088-a2be-bd63623d7e71', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a328bef4-e628-4998-bf6a-4c02046b8e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:55 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume volume-987dde6e-5004-4088-a2be-bd63623d7e71 (987dde6e-5004-4088-a2be-bd63623d7e71): created successfully Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a328bef4-e628-4998-bf6a-4c02046b8e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (97a51742-92b6-4031-bcef-5446751dbb72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a16c4d54-c0e0-4afc-b218-97909238fe79 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created volume successfully. Jul 07 08:22:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-13e4a8dc-9d99-4692-af2b-1fa0e58e442c req-c6e6d922-9ac9-4484-ab26-5ea8e7e14105 tempest-AttachVolumeNegativeTest-1177918499 None] Terminate volume connection completed successfully. Jul 07 08:22:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-13e4a8dc-9d99-4692-af2b-1fa0e58e442c req-c6e6d922-9ac9-4484-ab26-5ea8e7e14105 tempest-AttachVolumeNegativeTest-1177918499 None] Deleting attachment 8a051454-5420-4a8a-968f-0d8abf861b9f. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:22:56 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d 1073741824" returned: 0 in 0.901s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:56 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d Jul 07 08:22:56 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:57 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d" returned: 0 in 0.752s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1538e88a-eb95-4634-9a0b-55873495e758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7478a679-cfa9-4b98-97cf-6ea8ab1293e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:22:57 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Volume volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d (4d9c51e5-dad6-4ccc-90df-abdeee561d3d): created successfully Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7478a679-cfa9-4b98-97cf-6ea8ab1293e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Flow 'volume_create_manager' (17ed3131-eb73-41f4-8c95-e4fca9c2337f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:22:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-83d4279d-c1bd-4d9c-a225-abc21d68ee9c tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created volume successfully. Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-4d9c51e5-dad6-4ccc-90df-abdeee561d3d-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-4d9c51e5-dad6-4ccc-90df-abdeee561d3d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-quobyte-4d9c51e5-dad6-4ccc-90df-abdeee561d3d" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:22:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-4d9c51e5-dad6-4ccc-90df-abdeee561d3d" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:22:58 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7c01df-1001-44a0-94e5-3cff8582dad1]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:22:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:58 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d Jul 07 08:22:58 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:58 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d" returned: 0 in 0.813s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:58 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d Jul 07 08:22:58 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:22:59 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 07 08:22:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4d9c51e5-dad6-4ccc-90df-abdeee561d3d" returned: 0 in 0.660s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:22:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-4d9c51e5-dad6-4ccc-90df-abdeee561d3d" released by "delete_volume" :: held 1.528s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:22:59 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created reservations ['f55cfad5-dd65-4d3a-9842-7e3c2fd3fafe', '3c8cea6c-3278-4b98-8d37-84c99642224b', 'cd2682f0-6384-4752-95a0-5492d8442e57', '16ba0454-730d-4f42-b3db-aeb407fc2ddf'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:22:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:22:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:22:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:22:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:22:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:22:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:22:59 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:22:59 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-987dde6e-5004-4088-a2be-bd63623d7e71-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-987dde6e-5004-4088-a2be-bd63623d7e71-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-quobyte-987dde6e-5004-4088-a2be-bd63623d7e71" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-987dde6e-5004-4088-a2be-bd63623d7e71" acquired by "delete_volume" :: waited 0.048s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43cd06a-3351-4d90-842f-579e11d16267]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:00 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71 Jul 07 08:23:00 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:00 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.280s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:00 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:00 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Deleted volume successfully. Jul 07 08:23:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-623df9e3-c93a-4897-8eef-45e706ea5ef7 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-4d9c51e5-dad6-4ccc-90df-abdeee561d3d-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:01 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71" returned: 0 in 1.419s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:02 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71 Jul 07 08:23:02 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:02 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-987dde6e-5004-4088-a2be-bd63623d7e71" returned: 0 in 0.953s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-987dde6e-5004-4088-a2be-bd63623d7e71" released by "delete_volume" :: held 2.488s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created reservations ['2838016a-5872-4a87-a1a3-b743e6217dd8', 'd4cdbb6b-5d2b-4267-9b58-0caec2ecec16', '6d639a26-4508-4408-9010-1a2672c601b8', '68ef8793-5178-4ea1-8ebf-74b02ab6e722'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:03 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:03 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (dcdfad12-2a8a-4cba-adca-0790818a270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42a42a7-ad52-4517-b18c-cc0b939852b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42a42a7-ad52-4517-b18c-cc0b939852b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-477307383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246e230a-3605-4274-b0c9-c3e3a61ff2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:03Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c416c05e-a68d-4b32-abc6-f804d18fd4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c416c05e-a68d-4b32-abc6-f804d18fd4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6099dda6-fb75-4864-abd9-b8a9f1642227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6099dda6-fb75-4864-abd9-b8a9f1642227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '246e230a-3605-4274-b0c9-c3e3a61ff2ce', 'volume_name': 'volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06235ea7-1ff5-4061-8b71-54b8f880fd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06235ea7-1ff5-4061-8b71-54b8f880fd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aedcb02-e1c9-431d-a54f-2b137131f6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:03 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Volume 246e230a-3605-4274-b0c9-c3e3a61ff2ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce', 'volume_size': 1} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-477307383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246e230a-3605-4274-b0c9-c3e3a61ff2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:03Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Creating volume 246e230a-3605-4274-b0c9-c3e3a61ff2ce {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:03 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:03 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce 1073741824 Jul 07 08:23:03 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-quobyte-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:03 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.839s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:03 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Deleted volume successfully. Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b15876-571e-477e-a1c2-b8d93a9772d3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bb2e2c0d-3492-49fb-8535-ee867ecf22b1 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-987dde6e-5004-4088-a2be-bd63623d7e71-delete_volume" released by "delete_volume" :: held 3.707s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:04 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd Jul 07 08:23:04 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:04 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce 1073741824" returned: 0 in 1.060s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:04 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce Jul 07 08:23:04 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:04 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:04 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:05 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd" returned: 0 in 1.071s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:05 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd Jul 07 08:23:05 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:05 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce" returned: 0 in 0.964s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aedcb02-e1c9-431d-a54f-2b137131f6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21e64c9-2703-43f8-94a6-f88368bf3644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:05 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Volume volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce (246e230a-3605-4274-b0c9-c3e3a61ff2ce): created successfully Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21e64c9-2703-43f8-94a6-f88368bf3644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (dcdfad12-2a8a-4cba-adca-0790818a270e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:05 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-72da3e0f-405d-416e-8458-5e0c8afb11dd tempest-VolumesActionsTest-553207589 None] Created volume successfully. Jul 07 08:23:05 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.046s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:23:05 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd" returned: 0 in 0.792s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd" released by "delete_volume" :: held 1.957s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:05 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created reservations ['0da74795-ad5c-481e-96b2-01e0e2817262', 'd4e32354-4f82-4184-9b44-9ed99ddde4a1', 'c578c48c-4f6c-4df7-a54a-f158cfcb0e60', '2df53811-32f0-4a88-bd2d-4d64a3ac0b2d'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:06 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:06 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-72989079-fc96-4a32-8e0d-2cc6896bedbe-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-72989079-fc96-4a32-8e0d-2cc6896bedbe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-quobyte-72989079-fc96-4a32-8e0d-2cc6896bedbe" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-72989079-fc96-4a32-8e0d-2cc6896bedbe" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fb76b1-b195-4555-8214-f920ca820eab]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:06 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe Jul 07 08:23:06 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2bb718dd-1dc0-4184-a8cb-4141a09972e8 tempest-VolumesActionsTest-553207589 None] Acquiring lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce" by "attach_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2bb718dd-1dc0-4184-a8cb-4141a09972e8 tempest-VolumesActionsTest-553207589 None] Lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce" acquired by "attach_volume" :: waited 0.035s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2bb718dd-1dc0-4184-a8cb-4141a09972e8 tempest-VolumesActionsTest-553207589 None] Attaching volume 246e230a-3605-4274-b0c9-c3e3a61ff2ce to instance d29402ba-5bd0-4c89-8124-6daffd68ed1b at mountpoint /dev/vdb on host None. Jul 07 08:23:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2bb718dd-1dc0-4184-a8cb-4141a09972e8 tempest-VolumesActionsTest-553207589 None] Attach volume completed successfully. Jul 07 08:23:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2bb718dd-1dc0-4184-a8cb-4141a09972e8 tempest-VolumesActionsTest-553207589 None] Lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce" released by "attach_volume" :: held 0.248s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:07 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.069s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:07 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Deleted volume successfully. Jul 07 08:23:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e3064ed5-4de3-4175-a708-f53546253743 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-5d33e4cd-7275-4d8c-b785-3ea5438bdcdd-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:07 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe" returned: 0 in 1.077s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:07 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe Jul 07 08:23:07 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9179b253-1dd9-4253-b6b2-51cc2ae753cb tempest-VolumesActionsTest-1721758674 None] Terminate volume connection completed successfully. Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9179b253-1dd9-4253-b6b2-51cc2ae753cb tempest-VolumesActionsTest-1721758674 None] Acquiring lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce-detach_volume" by "detach_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9179b253-1dd9-4253-b6b2-51cc2ae753cb tempest-VolumesActionsTest-1721758674 None] Lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:08 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-72989079-fc96-4a32-8e0d-2cc6896bedbe" returned: 0 in 0.796s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-72989079-fc96-4a32-8e0d-2cc6896bedbe" released by "delete_volume" :: held 1.972s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9179b253-1dd9-4253-b6b2-51cc2ae753cb tempest-VolumesActionsTest-1721758674 None] Detaching volume 246e230a-3605-4274-b0c9-c3e3a61ff2ce from instance d29402ba-5bd0-4c89-8124-6daffd68ed1b. Jul 07 08:23:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9179b253-1dd9-4253-b6b2-51cc2ae753cb tempest-VolumesActionsTest-1721758674 None] Detach volume completed successfully. Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created reservations ['bfe4dcc6-b04e-44a0-8e64-74766b8baf90', '7339c631-50aa-4559-af1c-dc0a31e8d499', 'c119ab3b-a942-4006-8783-2b335196ebe2', 'e8e19ede-2b2a-451a-9837-9f4d20119bcd'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9179b253-1dd9-4253-b6b2-51cc2ae753cb tempest-VolumesActionsTest-1721758674 None] Lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:08 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:08 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-7afd9e16-d8ac-4862-a63d-64048709bf1b-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-7afd9e16-d8ac-4862-a63d-64048709bf1b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-quobyte-7afd9e16-d8ac-4862-a63d-64048709bf1b" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-7afd9e16-d8ac-4862-a63d-64048709bf1b" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c34616-e0b2-4328-983a-2540ef2d0248]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:08 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b Jul 07 08:23:08 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ab03382-ce75-4519-8c09-b48a04406b8d tempest-VolumesActionsTest-553207589 None] Acquiring lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce-detach_volume" by "detach_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ab03382-ce75-4519-8c09-b48a04406b8d tempest-VolumesActionsTest-553207589 None] Lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:09 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5ab03382-ce75-4519-8c09-b48a04406b8d tempest-VolumesActionsTest-553207589 None] Volume detach called, but volume not attached. Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ab03382-ce75-4519-8c09-b48a04406b8d tempest-VolumesActionsTest-553207589 None] Lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:09 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.934s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:09 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Deleted volume successfully. Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fea278be-b3e4-4e36-ac60-6d10779102bc tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-72989079-fc96-4a32-8e0d-2cc6896bedbe-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Acquiring lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:09 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b" returned: 0 in 1.104s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:09 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b Jul 07 08:23:09 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Acquiring lock "cinder-quobyte-246e230a-3605-4274-b0c9-c3e3a61ff2ce" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Lock "cinder-quobyte-246e230a-3605-4274-b0c9-c3e3a61ff2ce" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b413f1-4bcb-49d5-9ea4-b8f8e31dbf6d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:10 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce Jul 07 08:23:10 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:10 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7afd9e16-d8ac-4862-a63d-64048709bf1b" returned: 0 in 0.798s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-7afd9e16-d8ac-4862-a63d-64048709bf1b" released by "delete_volume" :: held 1.964s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created reservations ['6dce4aca-a560-4514-a0f5-6e7b5ff8260d', 'f57607c3-f006-4d9e-ba7a-723f397a40ed', 'c03625b3-be74-451b-afdf-d43fb2b8e07f', '79036e87-53e8-41c2-99a7-3d3d91811a2f'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:10 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce" returned: 0 in 0.943s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:10 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:10 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:10 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce Jul 07 08:23:10 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-48e526a8-ae67-4b8d-ba4c-e291579a4b89-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-48e526a8-ae67-4b8d-ba4c-e291579a4b89-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "cinder-quobyte-48e526a8-ae67-4b8d-ba4c-e291579a4b89" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-48e526a8-ae67-4b8d-ba4c-e291579a4b89" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:11 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f29352-e4bb-4e41-8d92-27901c18e5ba]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:11 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 Jul 07 08:23:11 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:11 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.110s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:11 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:12 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Deleted volume successfully. Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8203f9dd-9c8f-455a-9a63-d97dbeecfc44 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-7afd9e16-d8ac-4862-a63d-64048709bf1b-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:12 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246e230a-3605-4274-b0c9-c3e3a61ff2ce" returned: 0 in 1.192s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Lock "cinder-quobyte-246e230a-3605-4274-b0c9-c3e3a61ff2ce" released by "delete_volume" :: held 2.180s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Created reservations ['dcb1aafe-7c2a-45f3-affd-73349f503e9f', 'c4d3666d-773e-41cd-a71b-df99c8793b29', 'b1d2e3d1-f38e-41b6-b07e-8affa8224629', '5e88395d-d16b-40fe-bb29-9d25874a985a'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:12 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:12 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:12 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89" returned: 0 in 1.138s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:12 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89 Jul 07 08:23:12 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:13 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.644s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Deleted volume successfully. Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c6e16302-41df-4ef9-b42a-cd6d18882ca1 tempest-VolumesActionsTest-553207589 None] Lock "cinder-246e230a-3605-4274-b0c9-c3e3a61ff2ce-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:13 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-48e526a8-ae67-4b8d-ba4c-e291579a4b89" returned: 0 in 0.768s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-quobyte-48e526a8-ae67-4b8d-ba4c-e291579a4b89" released by "delete_volume" :: held 1.965s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Created reservations ['c2168237-62d4-426c-b4c5-8f71be8c6a60', 'f7311bff-897a-40d3-97dc-12f92a1227d1', '20912cb9-ff69-4be4-bf21-b6e0ecc8957a', 'aa254821-eaa2-4044-b5e7-c32b23f8c6fc'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:13 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:13 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:13 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.663s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:13 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Deleted volume successfully. Jul 07 08:23:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-250d3293-f3f2-4b9f-a814-4e53e977c9b0 tempest-CreateVolumesFromSourceVolumeTest-2779495 None] Lock "cinder-48e526a8-ae67-4b8d-ba4c-e291579a4b89-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Flow 'volume_create_manager' (7f928df7-9632-4eff-adad-63943b9a2f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b6d381-39b5-47c2-85d9-65059b67b163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b6d381-39b5-47c2-85d9-65059b67b163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62b2811-c2d7-49d9-9a7b-c67ab305a035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2644823a94479c8198df9be3206d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:19Z,use_quota=True,user_id='991f576d29c740879fb74bdd2759a440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ac5663-557b-4bc7-8ba4-84c2f0475979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ac5663-557b-4bc7-8ba4-84c2f0475979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe21a54-c191-4e0d-81c2-4f430a5366f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.image.glance [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Creating Keystone auth plugin from conf {{(pid=87179) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe21a54-c191-4e0d-81c2-4f430a5366f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c62b2811-c2d7-49d9-9a7b-c67ab305a035', 'volume_name': 'volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035', 'volume_size': 1, 'image_id': '36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba25e756579dd3a5fc0259e017ffd680', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f2644823a94479c8198df9be3206d2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a39e6b1e10f7fe71708df0b8233a5c4f480bef508d7ea4023374c8dc5c62a2400ef2c7ed9c594fa4c6f3a93713947db44e63f489ea11a02cecda943095becf6', 'id': '36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'created_at': datetime.datetime(2026, 7, 7, 6, 23, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 23, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36eacd72-ea3a-4d1b-9c85-3672b36193ab/file', 'properties': {}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04332a1-5f1f-43f0-aaec-886696870efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04332a1-5f1f-43f0-aaec-886696870efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44728ea6-fb5a-4b8b-b39c-6ec768e37b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:19 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Volume c62b2811-c2d7-49d9-9a7b-c67ab305a035: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035', 'volume_size': 1, 'image_id': '36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba25e756579dd3a5fc0259e017ffd680', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f2644823a94479c8198df9be3206d2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a39e6b1e10f7fe71708df0b8233a5c4f480bef508d7ea4023374c8dc5c62a2400ef2c7ed9c594fa4c6f3a93713947db44e63f489ea11a02cecda943095becf6', 'id': '36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'created_at': datetime.datetime(2026, 7, 7, 6, 23, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 23, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36eacd72-ea3a-4d1b-9c85-3672b36193ab/file', 'properties': {}}, 'image_service': } Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Trying to clone c62b2811-c2d7-49d9-9a7b-c67ab305a035 from image 36eacd72-ea3a-4d1b-9c85-3672b36193ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'metadata': {}}]). {{(pid=87179) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:23:19 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:23:19 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Image download 0.00 MB at 0.00 MB/s Jul 07 08:23:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[89303113-375b-47a3-96a3-eb93a87bccf0]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:20 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD Jul 07 08:23:20 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:20 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:20 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD Jul 07 08:23:20 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (5a6b93c7-6708-4496-b867-4ff371146e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cba7273-e538-4e0d-841d-06d0de6d3223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cba7273-e538-4e0d-841d-06d0de6d3223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1785415376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9459a23a-c7e1-4d75-84a4-b36b6eeca9c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:21Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a47416-8423-48b9-8028-76eb84684bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a47416-8423-48b9-8028-76eb84684bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1582da10-598b-44af-affd-c01547e33e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1582da10-598b-44af-affd-c01547e33e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9459a23a-c7e1-4d75-84a4-b36b6eeca9c5', 'volume_name': 'volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bc0a36-9877-4bff-b114-0348fcccb765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bc0a36-9877-4bff-b114-0348fcccb765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f62a7ff-3e88-4f5b-9a36-af760307aca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:21 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Volume 9459a23a-c7e1-4d75-84a4-b36b6eeca9c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5', 'volume_size': 1} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1785415376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9459a23a-c7e1-4d75-84a4-b36b6eeca9c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:21Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Creating volume 9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:21 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:21 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD" returned: 1 in 1.024s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Temporary image 36eacd72-ea3a-4d1b-9c85-3672b36193ab is fetched for user 991f576d29c740879fb74bdd2759a440. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:23:21 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 1073741824 Jul 07 08:23:21 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b6c54-4f90-4eff-b5f6-bda40e275b08]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:22 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD Jul 07 08:23:22 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:22 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 1073741824" returned: 0 in 1.095s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:22 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD" returned: 0 in 0.997s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:22 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 Jul 07 08:23:22 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:23 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD Jul 07 08:23:23 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:23 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5" returned: 0 in 0.774s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f62a7ff-3e88-4f5b-9a36-af760307aca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8008d5-889c-4655-8014-a46580f90612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:23 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Volume volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 (9459a23a-c7e1-4d75-84a4-b36b6eeca9c5): created successfully Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8008d5-889c-4655-8014-a46580f90612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (5a6b93c7-6708-4496-b867-4ff371146e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:23 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD" returned: 1 in 0.837s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62b2811-c2d7-49d9-9a7b-c67ab305a035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2644823a94479c8198df9be3206d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:19Z,use_quota=True,user_id='991f576d29c740879fb74bdd2759a440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Creating volume c62b2811-c2d7-49d9-9a7b-c67ab305a035 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:23 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:23:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:23 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f1e8bba9-f5c8-4b6b-a9ee-abb96308456f tempest-VolumesActionsTest-553207589 None] Created volume successfully. Jul 07 08:23:23 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 1073741824 Jul 07 08:23:23 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:24 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 1073741824" returned: 0 in 0.974s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "cinder-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:24 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 Jul 07 08:23:24 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "cinder-quobyte-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-quobyte-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[65157aef-5e46-4ecb-a495-43f2a3489019]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:25 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 Jul 07 08:23:25 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:25 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035" returned: 0 in 0.711s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:25 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Attempting download of 36eacd72-ea3a-4d1b-9c85-3672b36193ab ((None, [{'url': 'file:///opt/stack/data/glance/images/36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'metadata': {}}])) to volume c62b2811-c2d7-49d9-9a7b-c67ab305a035. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:23:25 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[62980623-f0f9-4f9d-97e1-c0f1a9f83522]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o1pyb5uz {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:25 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o1pyb5uz Jul 07 08:23:25 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:25 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5" returned: 0 in 1.010s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:25 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5 Jul 07 08:23:25 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:26 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5" returned: 0 in 0.732s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-quobyte-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5" released by "delete_volume" :: held 1.792s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Created reservations ['b7c237f3-5fa0-4be1-b773-2aee7b0720d1', 'c3823df4-d42b-4382-806f-8837f69148ab', '44d293be-cb22-409a-9764-283466d925f6', '67110b60-5c6b-40b6-8bdc-1444709e5077'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:26 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o1pyb5uz" returned: 0 in 1.149s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o1pyb5uz {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:26 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:26 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:26 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o1pyb5uz Jul 07 08:23:26 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:27 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.870s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:27 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Deleted volume successfully. Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0f4271ce-c275-41fa-9df2-20c751c887b5 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-9459a23a-c7e1-4d75-84a4-b36b6eeca9c5-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (a35b6a17-cf74-48da-9a97-d7af1410d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083b2a04-6fee-4521-9377-eae28b1b48cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083b2a04-6fee-4521-9377-eae28b1b48cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1604257085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56361d9-55b2-458d-a349-4413be83835a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:28Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5416d460-4266-4883-a21a-101b0e3a4075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5416d460-4266-4883-a21a-101b0e3a4075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb4801f-3705-45a1-950a-43283fdd111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb4801f-3705-45a1-950a-43283fdd111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56361d9-55b2-458d-a349-4413be83835a', 'volume_name': 'volume-b56361d9-55b2-458d-a349-4413be83835a', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304282af-a12c-4782-8d1d-d94ce0861aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304282af-a12c-4782-8d1d-d94ce0861aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1949140-0fd1-4a2d-9b8a-7ea842aa5ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:28 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Volume b56361d9-55b2-458d-a349-4413be83835a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56361d9-55b2-458d-a349-4413be83835a', 'volume_size': 1} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1604257085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56361d9-55b2-458d-a349-4413be83835a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:28Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Creating volume b56361d9-55b2-458d-a349-4413be83835a {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:28 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:28 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o1pyb5uz" returned: 1 in 1.291s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o1pyb5uz' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d80870-c468-48a4-a43c-e632ea9e6819]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:28 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a 1073741824 Jul 07 08:23:28 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:28 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD Jul 07 08:23:28 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:28 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:28 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a 1073741824" returned: 0 in 0.908s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:28 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD Jul 07 08:23:28 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:29 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a Jul 07 08:23:29 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:29 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD" returned: 1 in 0.773s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] 36eacd72-ea3a-4d1b-9c85-3672b36193ab was raw, converting to raw {{(pid=87179) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:29 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a" returned: 0 in 0.653s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:29 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 Jul 07 08:23:29 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1949140-0fd1-4a2d-9b8a-7ea842aa5ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56361d9-55b2-458d-a349-4413be83835a', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1275cf04-b49d-4f99-824d-adf9ce56f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:29 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Volume volume-b56361d9-55b2-458d-a349-4413be83835a (b56361d9-55b2-458d-a349-4413be83835a): created successfully Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1275cf04-b49d-4f99-824d-adf9ce56f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (a35b6a17-cf74-48da-9a97-d7af1410d4be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b6f68e88-e656-4903-9a88-f6513dfc6aa8 tempest-VolumesActionsTest-553207589 None] Created volume successfully. Jul 07 08:23:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "cinder-b56361d9-55b2-458d-a349-4413be83835a-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-b56361d9-55b2-458d-a349-4413be83835a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "cinder-quobyte-b56361d9-55b2-458d-a349-4413be83835a" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-quobyte-b56361d9-55b2-458d-a349-4413be83835a" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:30 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd9ceb8-02d6-48ab-bdc6-49d037c99a96]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:30 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a Jul 07 08:23:30 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:30 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035" returned: 0 in 0.813s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:30 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36eacd72-ea3a-4d1b-9c85-3672b36193ab_o9ytvi6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:23:30 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 08:23:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:30 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 1G Jul 07 08:23:30 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:31 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 1G" returned: 0 in 0.736s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:31 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a" returned: 0 in 0.923s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:31 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a Jul 07 08:23:31 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[849aff09-878b-449e-a811-59dabb661d6c]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:31 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 Jul 07 08:23:31 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:31 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b56361d9-55b2-458d-a349-4413be83835a" returned: 0 in 0.730s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-quobyte-b56361d9-55b2-458d-a349-4413be83835a" released by "delete_volume" :: held 1.696s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:31 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Created reservations ['c3c53241-bfe9-4ff4-8ffa-a073a6d12a08', '720ca3a8-832e-41f7-805d-4530380ee1c7', '7c8ca25c-031d-4d39-994c-b00495a319b7', '73ad6a5d-e822-4009-8adf-5d402a6f43f2'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:32 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:32 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:32 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035" returned: 0 in 0.905s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:32 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 Jul 07 08:23:32 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:32 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.886s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:32 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:32 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Deleted volume successfully. Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c020a3c1-c614-4fcd-ad69-bb8d25569368 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-b56361d9-55b2-458d-a349-4413be83835a-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (53569a4c-3950-45cd-adc0-30dc24eac126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c8f495-7e3d-4074-97a0-a92d1aacd388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c8f495-7e3d-4074-97a0-a92d1aacd388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-510366767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63d53da-f223-4776-a7a5-6e50f6a6489f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:33Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade2d19a-501c-4cb6-b3a4-6f15487f1b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade2d19a-501c-4cb6-b3a4-6f15487f1b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f6b63a-5ef1-4994-9823-799f9f6530cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f6b63a-5ef1-4994-9823-799f9f6530cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63d53da-f223-4776-a7a5-6e50f6a6489f', 'volume_name': 'volume-b63d53da-f223-4776-a7a5-6e50f6a6489f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571ccd51-8e9a-4d8a-bbeb-01709db19da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571ccd51-8e9a-4d8a-bbeb-01709db19da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed8f848-f186-4c77-9c68-433a0ab68150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Volume b63d53da-f223-4776-a7a5-6e50f6a6489f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63d53da-f223-4776-a7a5-6e50f6a6489f', 'volume_size': 1} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-510366767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63d53da-f223-4776-a7a5-6e50f6a6489f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:33Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Creating volume b63d53da-f223-4776-a7a5-6e50f6a6489f {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:33 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:33 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f 1073741824 Jul 07 08:23:33 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:33 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035" returned: 1 in 1.139s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Downloaded image 36eacd72-ea3a-4d1b-9c85-3672b36193ab ((None, [{'url': 'file:///opt/stack/data/glance/images/36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'metadata': {}}])) to volume c62b2811-c2d7-49d9-9a7b-c67ab305a035 successfully. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Temporary image 36eacd72-ea3a-4d1b-9c85-3672b36193ab for user 991f576d29c740879fb74bdd2759a440 is deleted. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Marking volume c62b2811-c2d7-49d9-9a7b-c67ab305a035 as bootable. {{(pid=87179) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Copying metadata from image 36eacd72-ea3a-4d1b-9c85-3672b36193ab to c62b2811-c2d7-49d9-9a7b-c67ab305a035. {{(pid=87179) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Creating volume glance metadata for volume c62b2811-c2d7-49d9-9a7b-c67ab305a035 backed by image 36eacd72-ea3a-4d1b-9c85-3672b36193ab with: {'image_id': '36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ba25e756579dd3a5fc0259e017ffd680', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87179) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44728ea6-fb5a-4b8b-b39c-6ec768e37b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035', 'volume_size': 1, 'image_id': '36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ba25e756579dd3a5fc0259e017ffd680', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f2644823a94479c8198df9be3206d2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a39e6b1e10f7fe71708df0b8233a5c4f480bef508d7ea4023374c8dc5c62a2400ef2c7ed9c594fa4c6f3a93713947db44e63f489ea11a02cecda943095becf6', 'id': '36eacd72-ea3a-4d1b-9c85-3672b36193ab', 'created_at': datetime.datetime(2026, 7, 7, 6, 23, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 23, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36eacd72-ea3a-4d1b-9c85-3672b36193ab/file', 'properties': {}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c353911-a9d4-4125-9aea-e7364c1f9edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Volume volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 (c62b2811-c2d7-49d9-9a7b-c67ab305a035): created successfully Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c353911-a9d4-4125-9aea-e7364c1f9edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Flow 'volume_create_manager' (7f928df7-9632-4eff-adad-63943b9a2f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c643320a-0a88-4a5c-a4d4-57076faf16af tempest-VolumeImageDependencyTests-1063996868 None] Created volume successfully. Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Acquiring lock "cinder-c62b2811-c2d7-49d9-9a7b-c67ab305a035-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Lock "cinder-c62b2811-c2d7-49d9-9a7b-c67ab305a035-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Acquiring lock "cinder-quobyte-c62b2811-c2d7-49d9-9a7b-c67ab305a035" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Lock "cinder-quobyte-c62b2811-c2d7-49d9-9a7b-c67ab305a035" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[589f65ea-c569-4635-84c4-2da349e4ab9f]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:33 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 Jul 07 08:23:33 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:34 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f 1073741824" returned: 0 in 1.000s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:34 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f Jul 07 08:23:34 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:34 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035" returned: 0 in 0.852s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:34 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 Jul 07 08:23:34 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:34 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f" returned: 0 in 0.681s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed8f848-f186-4c77-9c68-433a0ab68150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63d53da-f223-4776-a7a5-6e50f6a6489f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872d68c5-feaa-4435-ba97-5e06d1fe0cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:34 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Volume volume-b63d53da-f223-4776-a7a5-6e50f6a6489f (b63d53da-f223-4776-a7a5-6e50f6a6489f): created successfully Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872d68c5-feaa-4435-ba97-5e06d1fe0cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (53569a4c-3950-45cd-adc0-30dc24eac126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:34 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7aadfcbf-e108-41f2-9d46-11183c123b72 tempest-VolumesActionsTest-553207589 None] Created volume successfully. Jul 07 08:23:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "cinder-b63d53da-f223-4776-a7a5-6e50f6a6489f-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:35 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035" returned: 1 in 0.783s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:23:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-b63d53da-f223-4776-a7a5-6e50f6a6489f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:35 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035 Jul 07 08:23:35 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "cinder-quobyte-b63d53da-f223-4776-a7a5-6e50f6a6489f" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-quobyte-b63d53da-f223-4776-a7a5-6e50f6a6489f" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[228b18e8-f258-4569-a045-23f4e40658c5]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:35 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f Jul 07 08:23:35 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:36 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c62b2811-c2d7-49d9-9a7b-c67ab305a035" returned: 0 in 0.744s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Lock "cinder-quobyte-c62b2811-c2d7-49d9-9a7b-c67ab305a035" released by "delete_volume" :: held 2.452s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=88,cinder:INSERT=27,cinder:UPDATE=116,cinder:DELETE=9 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Created reservations ['820570da-d877-4d53-a075-b6ef2beb8d5f', 'af9d54b7-33c0-40f6-9073-603b70e0efa8', 'c36694a8-fab3-436d-a6fa-bd95339871cf', '49ab3130-66f7-4f35-b783-1fe6e814323a'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:36 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:36 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:36 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f" returned: 0 in 0.920s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:36 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f Jul 07 08:23:36 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:36 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.674s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:36 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Deleted volume successfully. Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d904c94a-19c1-447e-bba8-49423f4295c3 tempest-VolumeImageDependencyTests-1063996868 None] Lock "cinder-c62b2811-c2d7-49d9-9a7b-c67ab305a035-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:37 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b63d53da-f223-4776-a7a5-6e50f6a6489f" returned: 0 in 0.712s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-quobyte-b63d53da-f223-4776-a7a5-6e50f6a6489f" released by "delete_volume" :: held 1.684s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=116,cinder:SELECT=87,cinder:DELETE=11,cinder:INSERT=35 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Created reservations ['a9dc98cb-82e3-4aac-9fe2-be101ff39238', 'e442f636-32d1-4172-86be-12d138afbbd8', '2f646b05-aa24-4676-a64f-b5b396cf990c', '4e4d8396-7eb7-499b-b891-5c0ef0e26122'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:37 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:37 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:37 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.687s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:37 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:37 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Deleted volume successfully. Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4131b5a0-0252-4cbb-8d70-87efb5416151 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-b63d53da-f223-4776-a7a5-6e50f6a6489f-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (69ece683-5a56-42d2-926a-be511b736713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977efcbd-ef31-446f-811a-91e4d4664242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977efcbd-ef31-446f-811a-91e4d4664242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-542122174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1330b38-f6f5-47ec-b792-e13b6527d275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:38Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07871953-7cd4-4920-bee0-4db2a3718e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07871953-7cd4-4920-bee0-4db2a3718e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84aafeff-df43-4166-8e5e-aa32371216fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84aafeff-df43-4166-8e5e-aa32371216fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1330b38-f6f5-47ec-b792-e13b6527d275', 'volume_name': 'volume-b1330b38-f6f5-47ec-b792-e13b6527d275', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f598fb1f-07fc-49de-b67c-e418d64e8890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f598fb1f-07fc-49de-b67c-e418d64e8890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a26209-e546-46ab-bf89-32da7577612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:38 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Volume b1330b38-f6f5-47ec-b792-e13b6527d275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1330b38-f6f5-47ec-b792-e13b6527d275', 'volume_size': 1} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-542122174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1330b38-f6f5-47ec-b792-e13b6527d275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:38Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Creating volume b1330b38-f6f5-47ec-b792-e13b6527d275 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:38 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:23:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:38 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275 1073741824 Jul 07 08:23:38 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:39 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275 1073741824" returned: 0 in 0.854s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:39 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275 Jul 07 08:23:39 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:39 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275" returned: 0 in 0.622s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a26209-e546-46ab-bf89-32da7577612c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1330b38-f6f5-47ec-b792-e13b6527d275', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282aa378-5a3e-44c0-b68a-712aeab6e783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:39 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Volume volume-b1330b38-f6f5-47ec-b792-e13b6527d275 (b1330b38-f6f5-47ec-b792-e13b6527d275): created successfully Jul 07 08:23:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282aa378-5a3e-44c0-b68a-712aeab6e783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (69ece683-5a56-42d2-926a-be511b736713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:39 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-61a1e1db-2045-4c01-9ff1-fe5faed80412 tempest-VolumesActionsTest-553207589 None] Created volume successfully. Jul 07 08:23:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "cinder-b1330b38-f6f5-47ec-b792-e13b6527d275-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-b1330b38-f6f5-47ec-b792-e13b6527d275-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "cinder-quobyte-b1330b38-f6f5-47ec-b792-e13b6527d275" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-quobyte-b1330b38-f6f5-47ec-b792-e13b6527d275" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:40 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[017f9f81-e459-47e6-a66b-db6f78b17f67]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:40 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275 Jul 07 08:23:40 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:41 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275" returned: 0 in 0.789s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:41 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275 Jul 07 08:23:41 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:41 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b1330b38-f6f5-47ec-b792-e13b6527d275" returned: 0 in 0.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-quobyte-b1330b38-f6f5-47ec-b792-e13b6527d275" released by "delete_volume" :: held 1.483s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:42 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Created reservations ['51e25dec-e624-47b7-99bb-9f5ea0847717', '0327d7e6-684b-4825-be37-4b8032ea4dda', '61bc9fda-c02d-4a4a-99ee-8a8ed3284b31', 'd9e07e5c-fac6-4010-8a8d-fb0c33f17fb8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:42 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:42 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:42 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.852s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:42 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:42 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Deleted volume successfully. Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9dbfdbe8-a5f1-4089-96f7-46df6d7adc66 tempest-VolumesActionsTest-1721758674 None] Lock "cinder-b1330b38-f6f5-47ec-b792-e13b6527d275-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (f31e89a4-b052-44f5-90b6-71ba976845fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b754e6-de33-4308-87d7-2960cfc2bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b754e6-de33-4308-87d7-2960cfc2bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1267386905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64253b80-4018-46d5-9aee-05e3e2c13730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:43Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b249e247-939e-4cf0-b3e4-10e70991145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b249e247-939e-4cf0-b3e4-10e70991145f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd4d967-80eb-45d4-929a-4fc7f624fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd4d967-80eb-45d4-929a-4fc7f624fae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64253b80-4018-46d5-9aee-05e3e2c13730', 'volume_name': 'volume-64253b80-4018-46d5-9aee-05e3e2c13730', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed69a29-130a-4047-8028-59cada756fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed69a29-130a-4047-8028-59cada756fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8da422-a9f4-42c0-a9fb-7e0a3ff0d1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:43 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Volume 64253b80-4018-46d5-9aee-05e3e2c13730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64253b80-4018-46d5-9aee-05e3e2c13730', 'volume_size': 1} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1267386905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64253b80-4018-46d5-9aee-05e3e2c13730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17da24a5d39542558ad14a079eebdfe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:43Z,use_quota=True,user_id='3dcfb9b808b0476cb0d04ce995395f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Creating volume 64253b80-4018-46d5-9aee-05e3e2c13730 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:43 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:23:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:43 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730 1073741824 Jul 07 08:23:43 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:44 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730 1073741824" returned: 0 in 0.932s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:44 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730 Jul 07 08:23:44 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:45 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730" returned: 0 in 0.711s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8da422-a9f4-42c0-a9fb-7e0a3ff0d1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64253b80-4018-46d5-9aee-05e3e2c13730', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3277ab-6453-4003-a93d-1800431598de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:45 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Volume volume-64253b80-4018-46d5-9aee-05e3e2c13730 (64253b80-4018-46d5-9aee-05e3e2c13730): created successfully Jul 07 08:23:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3277ab-6453-4003-a93d-1800431598de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Flow 'volume_create_manager' (f31e89a4-b052-44f5-90b6-71ba976845fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ce41c912-40f4-4ff3-8d55-e080f16f8996 tempest-VolumesActionsTest-553207589 None] Created volume successfully. Jul 07 08:23:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Acquiring lock "cinder-64253b80-4018-46d5-9aee-05e3e2c13730-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Lock "cinder-64253b80-4018-46d5-9aee-05e3e2c13730-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Acquiring lock "cinder-quobyte-64253b80-4018-46d5-9aee-05e3e2c13730" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:23:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Lock "cinder-quobyte-64253b80-4018-46d5-9aee-05e3e2c13730" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:23:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc89a3ba-bf76-4b2b-867b-17023339d847]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:46 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730 Jul 07 08:23:46 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:46 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730" returned: 0 in 0.781s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:46 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730 Jul 07 08:23:46 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:47 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-64253b80-4018-46d5-9aee-05e3e2c13730" returned: 0 in 0.726s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Lock "cinder-quobyte-64253b80-4018-46d5-9aee-05e3e2c13730" released by "delete_volume" :: held 1.551s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Created reservations ['227adc20-f458-43f1-825a-1904d893ac15', '19185468-4c53-4f9e-b4d7-3ad813c14400', 'ecb7179b-52bb-4b98-8b69-6c074deca4cc', '57e8fbb2-afc4-4c0a-b1e1-9164e5002662'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:47 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:23:47 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Flow 'volume_create_manager' (c7d5cc02-6537-4fe7-ad5a-f4ab18ddbb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2550d810-f856-4039-8ce1-24f9adc21b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2550d810-f856-4039-8ce1-24f9adc21b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1109681949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c500db-be84-46cc-bea8-fba110924f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5ffc01a9b34514862ece8528f37ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:48Z,use_quota=True,user_id='32c4703bd1284fcda9977bfb426af94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38128bf4-95eb-44ae-804e-f480a2820968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38128bf4-95eb-44ae-804e-f480a2820968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f388da3-f4c5-425d-bcbf-d16feb4697ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f388da3-f4c5-425d-bcbf-d16feb4697ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c500db-be84-46cc-bea8-fba110924f7e', 'volume_name': 'volume-43c500db-be84-46cc-bea8-fba110924f7e', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73efd1aa-f390-492a-b795-318fb9156964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73efd1aa-f390-492a-b795-318fb9156964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cf0f43-85b7-4e36-9b4b-86d1e25f7cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:48 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Volume 43c500db-be84-46cc-bea8-fba110924f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c500db-be84-46cc-bea8-fba110924f7e', 'volume_size': 1} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1109681949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c500db-be84-46cc-bea8-fba110924f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5ffc01a9b34514862ece8528f37ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:23:48Z,use_quota=True,user_id='32c4703bd1284fcda9977bfb426af94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Creating volume 43c500db-be84-46cc-bea8-fba110924f7e {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:23:48 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:48 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e 1073741824 Jul 07 08:23:48 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:48 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.755s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:23:48 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Deleted volume successfully. Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2c2bf0af-2350-437e-8cce-95641bbd1559 tempest-VolumesActionsTest-553207589 None] Lock "cinder-64253b80-4018-46d5-9aee-05e3e2c13730-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:23:48 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e 1073741824" returned: 0 in 0.972s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:49 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e Jul 07 08:23:49 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:49 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e" returned: 0 in 0.717s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:23:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cf0f43-85b7-4e36-9b4b-86d1e25f7cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c500db-be84-46cc-bea8-fba110924f7e', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c1ded2-8a3c-4ef8-a486-5089e3516fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:23:49 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Volume volume-43c500db-be84-46cc-bea8-fba110924f7e (43c500db-be84-46cc-bea8-fba110924f7e): created successfully Jul 07 08:23:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c1ded2-8a3c-4ef8-a486-5089e3516fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:23:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Flow 'volume_create_manager' (c7d5cc02-6537-4fe7-ad5a-f4ab18ddbb47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:23:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3d4e52e6-9c1d-400d-9857-eda9f00142a1 tempest-AttachVolumeNegativeTest-1177918499 None] Created volume successfully. Jul 07 08:23:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-3bceb76a-e513-4ac5-b489-c78e5338973e req-03497970-e88e-441c-aea6-715fcb8aa4a4 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:23:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-3bceb76a-e513-4ac5-b489-c78e5338973e req-03497970-e88e-441c-aea6-715fcb8aa4a4 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:23:53 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc4abae-56b8-4bf9-aa15-d3de56a6064a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:23:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-3bceb76a-e513-4ac5-b489-c78e5338973e req-03497970-e88e-441c-aea6-715fcb8aa4a4 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:23:53 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e Jul 07 08:23:53 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:23:54 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 07 08:23:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-3bceb76a-e513-4ac5-b489-c78e5338973e req-03497970-e88e-441c-aea6-715fcb8aa4a4 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e" returned: 0 in 0.957s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:23:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-3bceb76a-e513-4ac5-b489-c78e5338973e req-03497970-e88e-441c-aea6-715fcb8aa4a4 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.988s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:23:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-3bceb76a-e513-4ac5-b489-c78e5338973e req-03497970-e88e-441c-aea6-715fcb8aa4a4 tempest-AttachVolumeNegativeTest-1177918499 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-43c500db-be84-46cc-bea8-fba110924f7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8bad0bc-b25b-4caf-aaba-fe8abfe49158', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:23:54 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-3bceb76a-e513-4ac5-b489-c78e5338973e req-03497970-e88e-441c-aea6-715fcb8aa4a4 tempest-AttachVolumeNegativeTest-1177918499 None] attachment_update completed successfully. Jul 07 08:24:01 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-61be5556-7087-4b22-8336-debafb95fe5f req-a6db3a95-6e82-4f6a-a983-37ce8b792b87 tempest-AttachVolumeNegativeTest-1177918499 None] Terminate volume connection completed successfully. Jul 07 08:24:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-61be5556-7087-4b22-8336-debafb95fe5f req-a6db3a95-6e82-4f6a-a983-37ce8b792b87 tempest-AttachVolumeNegativeTest-1177918499 None] Deleting attachment b8bad0bc-b25b-4caf-aaba-fe8abfe49158. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:24:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:24:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:04 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:24:04 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Flow 'volume_create_manager' (7c7fbaaf-40f7-4393-be87-2a907efcbb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dde4014-289f-4608-9a94-2a50bdfcc4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dde4014-289f-4608-9a94-2a50bdfcc4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-502623545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ac48df-7c14-4231-897d-ffd9543d1c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8558cace54d4eb9997f78ec2b2e20eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:05Z,use_quota=True,user_id='1ec6f28180bd4e1f84ef7b6b486f0b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2475b1c-6c7d-4489-8486-fbefe30b5956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2475b1c-6c7d-4489-8486-fbefe30b5956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dae08a0-84c4-494e-8363-d904e39e2e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dae08a0-84c4-494e-8363-d904e39e2e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ac48df-7c14-4231-897d-ffd9543d1c60', 'volume_name': 'volume-88ac48df-7c14-4231-897d-ffd9543d1c60', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d66758f-19b2-48a6-8f7e-2c97c28185c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d66758f-19b2-48a6-8f7e-2c97c28185c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c9b88f-6dc6-4973-ad92-5d49ce233497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:05 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Volume 88ac48df-7c14-4231-897d-ffd9543d1c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ac48df-7c14-4231-897d-ffd9543d1c60', 'volume_size': 1} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-502623545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ac48df-7c14-4231-897d-ffd9543d1c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8558cace54d4eb9997f78ec2b2e20eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:05Z,use_quota=True,user_id='1ec6f28180bd4e1f84ef7b6b486f0b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Creating volume 88ac48df-7c14-4231-897d-ffd9543d1c60 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:05 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:05 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60 1073741824 Jul 07 08:24:05 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:05 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.378s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:24:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:24:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:24:06 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60 1073741824" returned: 0 in 1.066s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:06 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60 Jul 07 08:24:06 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:07 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60" returned: 0 in 0.769s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c9b88f-6dc6-4973-ad92-5d49ce233497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ac48df-7c14-4231-897d-ffd9543d1c60', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665598fc-02e5-43da-9289-067ce469bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:07 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Volume volume-88ac48df-7c14-4231-897d-ffd9543d1c60 (88ac48df-7c14-4231-897d-ffd9543d1c60): created successfully Jul 07 08:24:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665598fc-02e5-43da-9289-067ce469bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Flow 'volume_create_manager' (7c7fbaaf-40f7-4393-be87-2a907efcbb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7fcf6ccb-e83c-42bc-9493-0b02e250020c tempest-AbsoluteLimitsTests-692398677 None] Created volume successfully. Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Acquiring lock "cinder-88ac48df-7c14-4231-897d-ffd9543d1c60-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Lock "cinder-88ac48df-7c14-4231-897d-ffd9543d1c60-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Acquiring lock "cinder-quobyte-88ac48df-7c14-4231-897d-ffd9543d1c60" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Flow 'volume_create_manager' (10351220-e699-4d9d-b74c-554fcd8657bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737b711c-6004-4b0d-80d2-09c2d79b7672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Lock "cinder-quobyte-88ac48df-7c14-4231-897d-ffd9543d1c60" acquired by "delete_volume" :: waited 0.047s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737b711c-6004-4b0d-80d2-09c2d79b7672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1719513244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ac531e-5ec7-42bb-951e-b163e7252b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9b47b4309458384fd652d03f5a544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:09Z,use_quota=True,user_id='b45f406823f94c549ca87d0a761769c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12900d57-aa16-45d2-856b-701e5b2d8e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12900d57-aa16-45d2-856b-701e5b2d8e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77304a23-2eb4-4de3-836c-19ab1a4ce57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77304a23-2eb4-4de3-836c-19ab1a4ce57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ac531e-5ec7-42bb-951e-b163e7252b53', 'volume_name': 'volume-19ac531e-5ec7-42bb-951e-b163e7252b53', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc76624-1e37-4774-9d45-1dbc4f1f0b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc76624-1e37-4774-9d45-1dbc4f1f0b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41d7442-627d-4704-a8e5-a30bfe9052c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:08 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Volume 19ac531e-5ec7-42bb-951e-b163e7252b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ac531e-5ec7-42bb-951e-b163e7252b53', 'volume_size': 1} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1719513244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ac531e-5ec7-42bb-951e-b163e7252b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9b47b4309458384fd652d03f5a544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:09Z,use_quota=True,user_id='b45f406823f94c549ca87d0a761769c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Creating volume 19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:08 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9305bb6f-031e-4ae1-ba07-81566ba5b054]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:08 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 1073741824 Jul 07 08:24:08 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:09 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60 Jul 07 08:24:09 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:09 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60" returned: 0 in 0.843s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:09 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 1073741824" returned: 0 in 0.865s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:09 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60 Jul 07 08:24:09 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:09 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 Jul 07 08:24:09 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:10 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88ac48df-7c14-4231-897d-ffd9543d1c60" returned: 0 in 0.679s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Lock "cinder-quobyte-88ac48df-7c14-4231-897d-ffd9543d1c60" released by "delete_volume" :: held 1.617s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Created reservations ['2894fd88-cf3c-4a4b-9665-c11df3867ce5', '06020f68-85f3-4a22-8bd4-f4286b8ca9af', '5f144470-63d7-4669-a57c-ee4f726d5ff9', '7a5d961c-bb62-4ac2-aa87-0ddcc9f3ba48'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:10 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53" returned: 0 in 0.714s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41d7442-627d-4704-a8e5-a30bfe9052c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ac531e-5ec7-42bb-951e-b163e7252b53', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33171fd0-5f10-4557-8815-751c9da098e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:10 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Volume volume-19ac531e-5ec7-42bb-951e-b163e7252b53 (19ac531e-5ec7-42bb-951e-b163e7252b53): created successfully Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33171fd0-5f10-4557-8815-751c9da098e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Flow 'volume_create_manager' (10351220-e699-4d9d-b74c-554fcd8657bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-162334ae-5729-4361-9c76-176015724914 tempest-SnapshotDependencyTests-732213142 None] Created volume successfully. Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:10 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:24:10 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Creating offline snapshot b7c3b243-49bb-4952-bed5-83eab7e95af4 of volume 19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:24:11 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ab5aa5-a8e1-4d14-8e65-2fb9be1d3071]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:11 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.714s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:11 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:11 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 Jul 07 08:24:11 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:11 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Deleted volume successfully. Jul 07 08:24:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bc17ea3f-eeaf-4819-a842-22e5c378dc08 tempest-AbsoluteLimitsTests-692398677 None] Lock "cinder-88ac48df-7c14-4231-897d-ffd9543d1c60-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:12 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53" returned: 0 in 0.901s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:12 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 1G Jul 07 08:24:12 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:13 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 1G" returned: 0 in 0.978s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ac531e-5ec7-42bb-951e-b163e7252b53 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:13 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ac531e-5ec7-42bb-951e-b163e7252b53 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 Jul 07 08:24:13 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:13 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ac531e-5ec7-42bb-951e-b163e7252b53 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4" returned: 0 in 0.753s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:13 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 is being set with open permissions: ugo+rw Jul 07 08:24:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:13 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 Jul 07 08:24:13 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:14 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4" returned: 0 in 0.712s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:14 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.info Jul 07 08:24:14 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:15 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.info" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:15 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.info is being set with open permissions: ugo+rw Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:15 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.info Jul 07 08:24:15 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Flow 'volume_create_manager' (bd12c18c-58ac-4cca-a6c1-00fa6c6c4a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84759df6-5490-4df9-90ad-0667305b9f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84759df6-5490-4df9-90ad-0667305b9f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1445302149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3350452-6573-42a7-816f-9fed1b1a053e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b398b3d05b4a3f9b6a22fba4aaf9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:16Z,use_quota=True,user_id='9ee6c0910a6b4a29931ef189e9fef52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a531fb17-9931-4934-aed2-210a03c05cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a531fb17-9931-4934-aed2-210a03c05cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eecb0e-96a3-4da2-8eef-f3ed410737c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eecb0e-96a3-4da2-8eef-f3ed410737c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3350452-6573-42a7-816f-9fed1b1a053e', 'volume_name': 'volume-a3350452-6573-42a7-816f-9fed1b1a053e', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8d2093-ceac-4e91-8b81-bb106e769446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8d2093-ceac-4e91-8b81-bb106e769446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3598a2-639b-4334-a254-d94fe1d812b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:15 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Volume a3350452-6573-42a7-816f-9fed1b1a053e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3350452-6573-42a7-816f-9fed1b1a053e', 'volume_size': 1} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:15 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.info" returned: 0 in 0.700s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.829s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1445302149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3350452-6573-42a7-816f-9fed1b1a053e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b398b3d05b4a3f9b6a22fba4aaf9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:16Z,use_quota=True,user_id='9ee6c0910a6b4a29931ef189e9fef52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Creating volume a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:15 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:24:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:15 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e 1073741824 Jul 07 08:24:15 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:16 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ff4d3cae-d8a5-492d-a801-15bb51c4a1f0 tempest-SnapshotDependencyTests-732213142 None] Create snapshot completed successfully Jul 07 08:24:16 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e 1073741824" returned: 0 in 0.924s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:16 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e Jul 07 08:24:16 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Flow 'volume_create_manager' (f7af4330-fb99-4e19-94d5-4dc3cc858836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456103c9-c14a-4af2-a409-38af7348684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456103c9-c14a-4af2-a409-38af7348684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9b47b4309458384fd652d03f5a544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b7c3b243-49bb-4952-bed5-83eab7e95af4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:17Z,use_quota=True,user_id='b45f406823f94c549ca87d0a761769c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5098591-1f94-4750-bd26-655f4f69a507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5098591-1f94-4750-bd26-655f4f69a507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4566df5-76ef-45b2-b71b-9c96cd04db4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4566df5-76ef-45b2-b71b-9c96cd04db4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018', 'volume_name': 'volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018', 'volume_size': 1, 'snapshot_id': 'b7c3b243-49bb-4952-bed5-83eab7e95af4'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100ef2cf-92f9-4d02-806d-83fce8dc001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100ef2cf-92f9-4d02-806d-83fce8dc001f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b353a5-209e-4526-8433-cbfd9912426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:17 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Volume 2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018', 'volume_size': 1, 'snapshot_id': 'b7c3b243-49bb-4952-bed5-83eab7e95af4'} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:17 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e" returned: 0 in 0.668s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.424s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "cinder-quobyte-b7c3b243-49bb-4952-bed5-83eab7e95af4-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" by "_create_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3598a2-639b-4334-a254-d94fe1d812b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3350452-6573-42a7-816f-9fed1b1a053e', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53c1823-fcbb-4705-b7e8-a6034d6644d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-b7c3b243-49bb-4952-bed5-83eab7e95af4-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Creating volume 2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 from snapshot b7c3b243-49bb-4952-bed5-83eab7e95af4 {{(pid=87179) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "cinder-quobyte-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:17 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Volume volume-a3350452-6573-42a7-816f-9fed1b1a053e (a3350452-6573-42a7-816f-9fed1b1a053e): created successfully Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53c1823-fcbb-4705-b7e8-a6034d6644d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Flow 'volume_create_manager' (bd12c18c-58ac-4cca-a6c1-00fa6c6c4a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] snapshot: b7c3b243-49bb-4952-bed5-83eab7e95af4, volume: 2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:24:17 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d0d28134-d18e-4867-a6d5-c4bf71250434 tempest-VolumesDeleteCascade-530446556 None] Created volume successfully. Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b99abb-0df3-48f6-bdde-adbdf0ac524b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:17 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 Jul 07 08:24:17 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:18 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4" returned: 0 in 0.811s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19ac531e-5ec7-42bb-951e-b163e7252b53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:24:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:24:18 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6b3287-bc0d-46af-8708-802ac96ae7cc]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:18 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 Jul 07 08:24:18 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:19 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53" returned: 0 in 0.771s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:19 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:24:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:19 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 Jul 07 08:24:19 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:24 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" returned: 0 in 5.123s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32b1ee6-b269-4080-84ba-aaaa23df8ff4]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:24 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 Jul 07 08:24:24 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:25 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53" returned: 0 in 0.931s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:25 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:24:25 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Converted 1024.00 MB image at 199.81 MB/s Jul 07 08:24:25 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 is being set with open permissions: ugo+rw Jul 07 08:24:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:25 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 Jul 07 08:24:25 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:26 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" returned: 0 in 0.671s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" released by "_copy_volume_from_snapshot" :: held 8.422s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-b7c3b243-49bb-4952-bed5-83eab7e95af4-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" released by "_create_volume_from_snapshot" :: held 8.464s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.505s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.112s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Creating offline snapshot 8f185c82-c2ff-4902-899e-232980c90d98 of volume a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb855e68-3418-4e5f-912e-ae7abeb9c63b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b353a5-209e-4526-8433-cbfd9912426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018', 'volume_size': 1, 'snapshot_id': 'b7c3b243-49bb-4952-bed5-83eab7e95af4'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c7701f-0cfd-4d88-95ea-a14d26cf66dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:26 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Volume volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 (2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018): created successfully Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c7701f-0cfd-4d88-95ea-a14d26cf66dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Flow 'volume_create_manager' (f7af4330-fb99-4e19-94d5-4dc3cc858836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-89677b75-7ec4-4141-a507-c056fbcd0946 tempest-SnapshotDependencyTests-732213142 None] Created volume successfully. Jul 07 08:24:26 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e Jul 07 08:24:26 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "cinder-b7c3b243-49bb-4952-bed5-83eab7e95af4-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-b7c3b243-49bb-4952-bed5-83eab7e95af4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "cinder-quobyte-19ac531e-5ec7-42bb-951e-b163e7252b53" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-19ac531e-5ec7-42bb-951e-b163e7252b53" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "cinder-quobyte-b7c3b243-49bb-4952-bed5-83eab7e95af4" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-b7c3b243-49bb-4952-bed5-83eab7e95af4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Deleting offline snapshot b7c3b243-49bb-4952-bed5-83eab7e95af4 of volume 19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] snapshot_file for this snap is: volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[23adfa53-d211-42db-ba5e-5f771deaecf8]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:26 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 Jul 07 08:24:26 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:26 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e" returned: 0 in 0.780s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:27 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 1G Jul 07 08:24:27 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:27 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4" returned: 0 in 0.824s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19ac531e-5ec7-42bb-951e-b163e7252b53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ec9b9e-d179-49c0-be18-ded03bcba81c]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:27 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 Jul 07 08:24:27 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:27 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 1G" returned: 0 in 0.859s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3350452-6573-42a7-816f-9fed1b1a053e -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:27 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3350452-6573-42a7-816f-9fed1b1a053e -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 Jul 07 08:24:27 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:28 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53" returned: 0 in 0.798s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:28 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3350452-6573-42a7-816f-9fed1b1a053e -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98" returned: 0 in 0.690s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:28 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 is being set with open permissions: ugo+rw Jul 07 08:24:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:28 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 Jul 07 08:24:28 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:28 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 Jul 07 08:24:28 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:29 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98" returned: 0 in 0.897s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:29 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4" returned: 0 in 0.967s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:29 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4 Jul 07 08:24:29 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:29 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.info Jul 07 08:24:29 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:30 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53.b7c3b243-49bb-4952-bed5-83eab7e95af4" returned: 0 in 0.765s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:30 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.info" returned: 0 in 0.787s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:30 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.info is being set with open permissions: ugo+rw Jul 07 08:24:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-b7c3b243-49bb-4952-bed5-83eab7e95af4" released by "_delete_snapshot" :: held 3.482s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-19ac531e-5ec7-42bb-951e-b163e7252b53" released by "delete_snapshot" :: held 3.508s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:30 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.info Jul 07 08:24:30 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:30 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Created reservations ['bd42c2e8-115a-4fdc-bef7-5e48bbfb5540', 'e4cbc59c-7906-4c1d-93f5-4f41d2b44efb', '6ffcfbd9-66fa-47a9-96b5-9f4a4767406a', '9346aaea-7f80-42d2-b925-b323d01275e3'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:30 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Delete snapshot completed successfully. Jul 07 08:24:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e6be5789-13ae-4806-a319-02da3966e280 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-b7c3b243-49bb-4952-bed5-83eab7e95af4-delete_snapshot" released by "delete_snapshot" :: held 3.664s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:31 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.info" returned: 0 in 0.701s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.898s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "cinder-19ac531e-5ec7-42bb-951e-b163e7252b53-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ab622db2-edb7-4abe-bb5d-febeee88c62b tempest-VolumesDeleteCascade-530446556 None] Create snapshot completed successfully Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-19ac531e-5ec7-42bb-951e-b163e7252b53-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "cinder-quobyte-19ac531e-5ec7-42bb-951e-b163e7252b53" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-19ac531e-5ec7-42bb-951e-b163e7252b53" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6152403-d142-4ab6-ab5a-d67b3cfca914]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:31 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 Jul 07 08:24:31 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Creating offline snapshot a283e451-1302-4a97-8369-f3ac09c99920 of volume a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c4b35f-c321-4c40-9790-59878eb48956]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:32 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 Jul 07 08:24:32 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:32 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53" returned: 0 in 0.904s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:32 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53 Jul 07 08:24:32 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:32 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98" returned: 0 in 0.876s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3350452-6573-42a7-816f-9fed1b1a053e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:32 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 1G Jul 07 08:24:32 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:33 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-19ac531e-5ec7-42bb-951e-b163e7252b53" returned: 0 in 0.907s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-19ac531e-5ec7-42bb-951e-b163e7252b53" released by "delete_volume" :: held 1.884s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Created reservations ['cd1398ec-4995-4545-bfa0-e5b9352c0c0d', 'ef0415d4-4a31-4b1b-beac-0e690c789338', '51bfdcb9-e364-426c-989e-62cd3bc9d01c', 'b6497fb3-a367-4a11-b006-80f45ef3d06b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:33 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:24:33 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "cinder-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "cinder-quobyte-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfd5dc2-ae31-4250-9d46-876b0f025ae1]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:33 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 Jul 07 08:24:33 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:33 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 1G" returned: 0 in 1.141s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:34 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 Jul 07 08:24:34 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:34 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.986s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:34 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:34 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Deleted volume successfully. Jul 07 08:24:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8bcd489e-b565-4740-8679-b5545ae706b1 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-19ac531e-5ec7-42bb-951e-b163e7252b53-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:34 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" returned: 0 in 1.176s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:34 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018 Jul 07 08:24:34 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:35 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920" returned: 0 in 1.026s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:35 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 is being set with open permissions: ugo+rw Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:35 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 Jul 07 08:24:35 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:35 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" returned: 0 in 0.829s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-quobyte-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018" released by "delete_volume" :: held 2.058s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Created reservations ['7811cbe1-7703-4f6b-9b6c-957bfac7700b', 'f5c7dd83-a775-4d37-998a-7710c1397a1e', '96d4194e-03da-427c-abd3-9ef47fbf1fdf', '737dfc71-a4f1-43bb-9ddb-cd242528f2f6'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:35 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:24:35 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:35 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920" returned: 0 in 0.830s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.021s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:35 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5d62557c-87a9-4e2a-a0b8-0e3380380f07 tempest-VolumesDeleteCascade-530446556 None] Create snapshot completed successfully Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-a3350452-6573-42a7-816f-9fed1b1a053e-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-a3350452-6573-42a7-816f-9fed1b1a053e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Performing cascade delete. {{(pid=87179) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-8f185c82-c2ff-4902-899e-232980c90d98-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-8f185c82-c2ff-4902-899e-232980c90d98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=80,cinder:SELECT=73,cinder:DELETE=8,cinder:INSERT=21 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-a3350452-6573-42a7-816f-9fed1b1a053e" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-a3350452-6573-42a7-816f-9fed1b1a053e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-8f185c82-c2ff-4902-899e-232980c90d98" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8f185c82-c2ff-4902-899e-232980c90d98" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Deleting offline snapshot 8f185c82-c2ff-4902-899e-232980c90d98 of volume a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] snapshot_file for this snap is: volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bea7158-f66b-480c-b2c0-1efb8118b5ea]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:36 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.770s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:36 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 Jul 07 08:24:36 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Deleted volume successfully. Jul 07 08:24:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-347d1dd0-48f6-4453-867a-4e0e7801e7f3 tempest-SnapshotDependencyTests-732213142 None] Lock "cinder-2a9ac5e3-3bf5-4bb4-a1e5-328c14a3f018-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:37 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98" returned: 0 in 0.833s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3350452-6573-42a7-816f-9fed1b1a053e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74d98f1-d0b5-4221-986b-66054c93b7c3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:37 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e Jul 07 08:24:37 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:38 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e" returned: 0 in 0.802s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:38 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0f3e4b-e3ef-42ec-9c64-ed12555ff0e9]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:38 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 Jul 07 08:24:38 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:39 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920" returned: 0 in 0.967s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3350452-6573-42a7-816f-9fed1b1a053e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:39 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[483482d3-f83a-4091-9545-3900dbf9c7a7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:39 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 Jul 07 08:24:39 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:40 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98" returned: 0 in 1.042s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3350452-6573-42a7-816f-9fed1b1a053e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:40 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a65998-776a-4330-bb74-50c134ee6ad7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:40 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e Jul 07 08:24:40 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:41 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e" returned: 0 in 0.966s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:41 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 Jul 07 08:24:41 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:41 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98" returned: 0 in 0.785s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:41 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98 Jul 07 08:24:41 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:42 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.8f185c82-c2ff-4902-899e-232980c90d98" returned: 0 in 0.716s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3350452-6573-42a7-816f-9fed1b1a053e /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 -F qcow2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:42 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3350452-6573-42a7-816f-9fed1b1a053e /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 -F qcow2 Jul 07 08:24:42 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:43 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3350452-6573-42a7-816f-9fed1b1a053e /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 -F qcow2" returned: 0 in 0.842s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8f185c82-c2ff-4902-899e-232980c90d98" released by "_delete_snapshot" :: held 7.144s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-a3350452-6573-42a7-816f-9fed1b1a053e" released by "delete_snapshot" :: held 7.175s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:INSERT=15,cinder:UPDATE=84,cinder:SELECT=62,cinder:DELETE=9 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Created reservations ['bfb87c30-f06f-47da-b4af-410b5c241de5', '2f4630cb-6914-421d-b220-625e244f7f15', 'ddbefb21-f711-4ea3-94c1-c0b4490320a1', '06d1de8c-9b82-4cc1-bbbd-a1b2e33b4553'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Delete snapshot completed successfully. Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-8f185c82-c2ff-4902-899e-232980c90d98-delete_snapshot" released by "delete_snapshot" :: held 7.381s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-a283e451-1302-4a97-8369-f3ac09c99920-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-a283e451-1302-4a97-8369-f3ac09c99920-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-a3350452-6573-42a7-816f-9fed1b1a053e" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-a3350452-6573-42a7-816f-9fed1b1a053e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-a283e451-1302-4a97-8369-f3ac09c99920" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-a283e451-1302-4a97-8369-f3ac09c99920" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Deleting offline snapshot a283e451-1302-4a97-8369-f3ac09c99920 of volume a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] snapshot_file for this snap is: volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[db09d2f8-7288-4c15-b78b-64ccdb69af21]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:44 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 Jul 07 08:24:44 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:44 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920" returned: 0 in 0.889s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3350452-6573-42a7-816f-9fed1b1a053e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced2fd91-8ee5-42bb-93f3-610a8aad3f6b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:44 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e Jul 07 08:24:44 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:45 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e" returned: 0 in 0.857s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:45 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 Jul 07 08:24:45 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:46 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920" returned: 0 in 0.857s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:46 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920 Jul 07 08:24:46 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:47 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e.a283e451-1302-4a97-8369-f3ac09c99920" returned: 0 in 0.691s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-a283e451-1302-4a97-8369-f3ac09c99920" released by "_delete_snapshot" :: held 3.440s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-a3350452-6573-42a7-816f-9fed1b1a053e" released by "delete_snapshot" :: held 3.487s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Created reservations ['ac94ea3c-bf75-47ca-ad97-ea32aab52bca', '36ae5ae7-ff0d-4334-a252-6da67d8359a9', 'a3e44736-9175-4592-9f28-234bc31be6e3', '5e2e7d88-08b4-4d8d-a517-67a5c68ae4ae'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Delete snapshot completed successfully. Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-a283e451-1302-4a97-8369-f3ac09c99920-delete_snapshot" released by "delete_snapshot" :: held 3.662s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Snapshots deleted, issuing volume delete {{(pid=87179) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-a3350452-6573-42a7-816f-9fed1b1a053e" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-a3350452-6573-42a7-816f-9fed1b1a053e" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1536873-bdf5-449d-a538-ebfabf0d2abe]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:47 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e Jul 07 08:24:47 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:48 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e" returned: 0 in 0.711s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:48 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e Jul 07 08:24:48 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:48 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a3350452-6573-42a7-816f-9fed1b1a053e" returned: 0 in 0.632s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-a3350452-6573-42a7-816f-9fed1b1a053e" released by "delete_volume" :: held 1.394s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Created reservations ['2e361b06-dea7-47a4-8258-90ceef20ab9b', 'a88de475-3213-49ec-8ebb-7faa95d13b28', '80bc3ce6-dc2f-428b-9e43-e022299ee2fc', '7acd18d9-2eda-4cc5-9ce2-a9aac71b8f1b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:48 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:24:48 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:49 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.646s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:24:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Deleted volume successfully. Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c71ca66-ef1c-4b00-b7bc-dbbd6e10c877 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-a3350452-6573-42a7-816f-9fed1b1a053e-delete_volume" released by "delete_volume" :: held 13.389s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Flow 'volume_create_manager' (4e0344b5-ee27-46ed-8e94-5039e684100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d7d016-cffe-47f7-be70-161570510997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d7d016-cffe-47f7-be70-161570510997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-604752361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67ab66b-58c9-4545-9baf-b0cda3272686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b398b3d05b4a3f9b6a22fba4aaf9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:50Z,use_quota=True,user_id='9ee6c0910a6b4a29931ef189e9fef52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b63a0d-0716-4ac0-8e5f-ac7a4ccd9162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b63a0d-0716-4ac0-8e5f-ac7a4ccd9162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fab3f4c-1f5b-4ccb-b06d-6a7fc03c5fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fab3f4c-1f5b-4ccb-b06d-6a7fc03c5fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd67ab66b-58c9-4545-9baf-b0cda3272686', 'volume_name': 'volume-d67ab66b-58c9-4545-9baf-b0cda3272686', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4139d3d-b7c8-4fd5-aa87-ea8455e05e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4139d3d-b7c8-4fd5-aa87-ea8455e05e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8863362d-dda0-4934-a60e-34a486227d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:49 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Volume d67ab66b-58c9-4545-9baf-b0cda3272686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d67ab66b-58c9-4545-9baf-b0cda3272686', 'volume_size': 1} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-604752361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67ab66b-58c9-4545-9baf-b0cda3272686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b398b3d05b4a3f9b6a22fba4aaf9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:50Z,use_quota=True,user_id='9ee6c0910a6b4a29931ef189e9fef52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Creating volume d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:49 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:24:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:49 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 1073741824 Jul 07 08:24:49 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:50 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 1073741824" returned: 0 in 0.765s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:50 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 Jul 07 08:24:50 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:51 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686" returned: 0 in 0.637s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8863362d-dda0-4934-a60e-34a486227d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67ab66b-58c9-4545-9baf-b0cda3272686', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f988ad-28b5-46ab-88ba-2458b68e9dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:51 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Volume volume-d67ab66b-58c9-4545-9baf-b0cda3272686 (d67ab66b-58c9-4545-9baf-b0cda3272686): created successfully Jul 07 08:24:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f988ad-28b5-46ab-88ba-2458b68e9dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Flow 'volume_create_manager' (4e0344b5-ee27-46ed-8e94-5039e684100c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d345decd-fb95-4d5e-8728-0dbd58284a99 tempest-VolumesDeleteCascade-530446556 None] Created volume successfully. Jul 07 08:24:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Creating offline snapshot 8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 of volume d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:24:52 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32c48da-868b-485b-b07a-93880d4de68e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:52 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 Jul 07 08:24:52 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:52 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686" returned: 0 in 0.785s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:52 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 1G Jul 07 08:24:52 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:53 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 1G" returned: 0 in 0.780s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67ab66b-58c9-4545-9baf-b0cda3272686 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:53 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67ab66b-58c9-4545-9baf-b0cda3272686 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 Jul 07 08:24:53 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:54 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67ab66b-58c9-4545-9baf-b0cda3272686 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2" returned: 0 in 0.667s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:54 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 is being set with open permissions: ugo+rw Jul 07 08:24:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:54 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 Jul 07 08:24:54 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:55 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2" returned: 0 in 0.617s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:55 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.info Jul 07 08:24:55 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:55 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.info" returned: 0 in 0.650s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:55 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.info is being set with open permissions: ugo+rw Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:55 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.info Jul 07 08:24:55 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Flow 'volume_create_manager' (190cc921-6659-492e-b4db-7cbec6ef6ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d9b946-c037-4c00-a8f9-1d6762c7fa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d9b946-c037-4c00-a8f9-1d6762c7fa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1109351590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c524f6b6-f27d-4147-9d0b-940130a89b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5ffc01a9b34514862ece8528f37ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:56Z,use_quota=True,user_id='32c4703bd1284fcda9977bfb426af94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450df4e0-8e4c-4b66-8b04-3628667c7160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450df4e0-8e4c-4b66-8b04-3628667c7160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482294d9-f09e-44a4-8267-41a210ca1709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482294d9-f09e-44a4-8267-41a210ca1709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c524f6b6-f27d-4147-9d0b-940130a89b0e', 'volume_name': 'volume-c524f6b6-f27d-4147-9d0b-940130a89b0e', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39efa603-fa1d-4593-b2b1-e00e868d8555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39efa603-fa1d-4593-b2b1-e00e868d8555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7c2372-4d2e-467c-8e88-b864a23cf07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:55 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Volume c524f6b6-f27d-4147-9d0b-940130a89b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c524f6b6-f27d-4147-9d0b-940130a89b0e', 'volume_size': 1} Jul 07 08:24:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:56 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.info" returned: 0 in 0.653s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.243s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1109351590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c524f6b6-f27d-4147-9d0b-940130a89b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5ffc01a9b34514862ece8528f37ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:56Z,use_quota=True,user_id='32c4703bd1284fcda9977bfb426af94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Creating volume c524f6b6-f27d-4147-9d0b-940130a89b0e {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:56 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:24:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:56 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e 1073741824 Jul 07 08:24:56 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3f393838-a440-4416-870f-f1123ebdcc0e tempest-VolumesDeleteCascade-530446556 None] Create snapshot completed successfully Jul 07 08:24:57 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e 1073741824" returned: 0 in 0.773s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:57 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e Jul 07 08:24:57 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:24:57 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e" returned: 0 in 0.653s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Flow 'volume_create_manager' (e832dbe9-1c71-4bf5-b025-2bee32a6e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1162ffdd-4c17-4d11-ac72-54f0f52e666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7c2372-4d2e-467c-8e88-b864a23cf07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c524f6b6-f27d-4147-9d0b-940130a89b0e', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b86ca9-bd3b-4e2a-9f35-5909cc15ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1162ffdd-4c17-4d11-ac72-54f0f52e666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1474772034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfc78dc-c230-4317-9dea-c40be050ef60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b398b3d05b4a3f9b6a22fba4aaf9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:24:58Z,use_quota=True,user_id='9ee6c0910a6b4a29931ef189e9fef52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a60aae5-2ccf-4031-9ff0-fe49a78c699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a60aae5-2ccf-4031-9ff0-fe49a78c699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7335cf89-60be-4d34-a7c7-d86893cbd64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7335cf89-60be-4d34-a7c7-d86893cbd64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8bfc78dc-c230-4317-9dea-c40be050ef60', 'volume_name': 'volume-8bfc78dc-c230-4317-9dea-c40be050ef60', 'volume_size': 1, 'snapshot_id': '8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0a2f33-2a44-4b97-a571-5a7ecf627b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0a2f33-2a44-4b97-a571-5a7ecf627b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c4daf2-efbf-46df-8c62-4e492428f13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:24:57 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Volume 8bfc78dc-c230-4317-9dea-c40be050ef60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8bfc78dc-c230-4317-9dea-c40be050ef60', 'volume_size': 1, 'snapshot_id': '8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2'} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2-8bfc78dc-c230-4317-9dea-c40be050ef60" by "_create_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:57 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Volume volume-c524f6b6-f27d-4147-9d0b-940130a89b0e (c524f6b6-f27d-4147-9d0b-940130a89b0e): created successfully Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b86ca9-bd3b-4e2a-9f35-5909cc15ec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Flow 'volume_create_manager' (190cc921-6659-492e-b4db-7cbec6ef6ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2-8bfc78dc-c230-4317-9dea-c40be050ef60" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Creating volume 8bfc78dc-c230-4317-9dea-c40be050ef60 from snapshot 8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 {{(pid=87179) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:24:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-8bfc78dc-c230-4317-9dea-c40be050ef60" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:24:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-fb6b5c4c-84db-4e08-88c3-b5991c92419e tempest-AttachVolumeNegativeTest-1177918499 None] Created volume successfully. Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8bfc78dc-c230-4317-9dea-c40be050ef60" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] snapshot: 8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2, volume: 8bfc78dc-c230-4317-9dea-c40be050ef60, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[392690cd-6640-4134-93b5-0b9de9297a7d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:58 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 Jul 07 08:24:58 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:58 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2" returned: 0 in 0.725s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d67ab66b-58c9-4545-9baf-b0cda3272686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1df13b-c3e9-4fb0-8a45-4f3819c42eea]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:24:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:58 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 Jul 07 08:24:58 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:24:59 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 07 08:24:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686" returned: 0 in 0.734s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:24:59 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:24:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:24:59 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 Jul 07 08:24:59 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-3a42fbf6-d24d-4474-8b4f-4cf4a391d014 req-f32ca12d-e524-4e46-a439-2b5dfbd1710d tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:04 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60" returned: 0 in 4.530s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74a4321-a4aa-4659-96c0-4af71879a32f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:04 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 Jul 07 08:25:04 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:04 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:04 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:04 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686" returned: 0 in 0.895s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:25:04 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Converted 1024.00 MB image at 226.03 MB/s Jul 07 08:25:04 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 is being set with open permissions: ugo+rw Jul 07 08:25:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:04 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 Jul 07 08:25:04 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:05 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.693s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:25:05 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60" returned: 0 in 0.622s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8bfc78dc-c230-4317-9dea-c40be050ef60" released by "_copy_volume_from_snapshot" :: held 7.587s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2-8bfc78dc-c230-4317-9dea-c40be050ef60" released by "_create_volume_from_snapshot" :: held 7.620s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.645s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-3a42fbf6-d24d-4474-8b4f-4cf4a391d014 req-f32ca12d-e524-4e46-a439-2b5dfbd1710d tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.126s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf92bf17-d6ea-43fd-9b85-668f6ebdc48a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-3a42fbf6-d24d-4474-8b4f-4cf4a391d014 req-f32ca12d-e524-4e46-a439-2b5dfbd1710d tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c4daf2-efbf-46df-8c62-4e492428f13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bfc78dc-c230-4317-9dea-c40be050ef60', 'volume_size': 1, 'snapshot_id': '8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dca3f67-238c-41f9-9380-d47895d41a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:05 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Volume volume-8bfc78dc-c230-4317-9dea-c40be050ef60 (8bfc78dc-c230-4317-9dea-c40be050ef60): created successfully Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dca3f67-238c-41f9-9380-d47895d41a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Flow 'volume_create_manager' (e832dbe9-1c71-4bf5-b025-2bee32a6e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:05 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b27b093f-96be-43ff-9121-ea071fd52e0e tempest-VolumesDeleteCascade-530446556 None] Created volume successfully. Jul 07 08:25:05 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e Jul 07 08:25:05 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:06 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-3a42fbf6-d24d-4474-8b4f-4cf4a391d014 req-f32ca12d-e524-4e46-a439-2b5dfbd1710d tempest-AttachVolumeNegativeTest-1177918499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e" returned: 0 in 0.817s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-3a42fbf6-d24d-4474-8b4f-4cf4a391d014 req-f32ca12d-e524-4e46-a439-2b5dfbd1710d tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.834s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-3a42fbf6-d24d-4474-8b4f-4cf4a391d014 req-f32ca12d-e524-4e46-a439-2b5dfbd1710d tempest-AttachVolumeNegativeTest-1177918499 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-c524f6b6-f27d-4147-9d0b-940130a89b0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e5570a1-8078-4158-89df-589cad70770a', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-d67ab66b-58c9-4545-9baf-b0cda3272686-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-3a42fbf6-d24d-4474-8b4f-4cf4a391d014 req-f32ca12d-e524-4e46-a439-2b5dfbd1710d tempest-AttachVolumeNegativeTest-1177918499 None] attachment_update completed successfully. Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-d67ab66b-58c9-4545-9baf-b0cda3272686-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Performing cascade delete. {{(pid=87179) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-d67ab66b-58c9-4545-9baf-b0cda3272686" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-d67ab66b-58c9-4545-9baf-b0cda3272686" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Deleting offline snapshot 8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 of volume d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] snapshot_file for this snap is: volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc70236b-55b9-47ef-ac68-bc05cad8e9c3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:06 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 Jul 07 08:25:06 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:07 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2" returned: 0 in 0.765s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d67ab66b-58c9-4545-9baf-b0cda3272686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:25:07 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ed00ac-f90c-4a1d-a0b9-4a31778ffdc8]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:07 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 Jul 07 08:25:07 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:08 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686" returned: 0 in 0.767s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:08 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 Jul 07 08:25:08 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:09 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2" returned: 0 in 0.795s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:09 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2 Jul 07 08:25:09 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:09 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686.8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2" returned: 0 in 0.644s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2" released by "_delete_snapshot" :: held 3.062s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-d67ab66b-58c9-4545-9baf-b0cda3272686" released by "delete_snapshot" :: held 3.087s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Created reservations ['a8340c89-fe69-44e4-9a52-730786f3f478', 'a0e56700-b70c-4172-8f50-3b6ea020cc41', 'aca7f354-4b44-41b8-9fe3-624b91d03a55', '904ce5b6-5063-4ab9-ab7d-dca7c5cb498c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:09 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Delete snapshot completed successfully. Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-8b04a1a5-0608-4df0-baf7-7d8d4f7da3a2-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Snapshots deleted, issuing volume delete {{(pid=87179) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-d67ab66b-58c9-4545-9baf-b0cda3272686" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-d67ab66b-58c9-4545-9baf-b0cda3272686" acquired by "delete_volume" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d87703f-076b-4245-85ca-44fc225fff6f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:10 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 Jul 07 08:25:10 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:10 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686" returned: 0 in 0.799s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:10 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686 Jul 07 08:25:10 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:11 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d67ab66b-58c9-4545-9baf-b0cda3272686" returned: 0 in 0.661s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-d67ab66b-58c9-4545-9baf-b0cda3272686" released by "delete_volume" :: held 1.517s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:11 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Created reservations ['d9d53611-08c9-41c4-bece-3a57669c1227', 'da92ea8e-9833-4bd6-8a8a-5b461c4515fb', '666bb495-27e3-494b-be5a-daf7504a532d', '0baa4353-8446-4264-ac3d-e64661f9ddb1'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:11 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:11 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-8bfc78dc-c230-4317-9dea-c40be050ef60-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-8bfc78dc-c230-4317-9dea-c40be050ef60-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "cinder-quobyte-8bfc78dc-c230-4317-9dea-c40be050ef60" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8bfc78dc-c230-4317-9dea-c40be050ef60" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d22f6d8-7c06-4462-8ce3-af75ea343399]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:12 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.696s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:12 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Deleted volume successfully. Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32a1c12b-8847-400b-b6b3-f26c24cb8290 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-d67ab66b-58c9-4545-9baf-b0cda3272686-delete_volume" released by "delete_volume" :: held 5.687s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:12 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 Jul 07 08:25:12 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:12 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60" returned: 0 in 0.750s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:13 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60 Jul 07 08:25:13 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-85077f3f-71d0-4018-9a7d-9c215751e0e7 req-9e8f92e3-d2d3-4d30-8eb6-44aee3ac3620 tempest-AttachVolumeNegativeTest-1177918499 None] Terminate volume connection completed successfully. Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-85077f3f-71d0-4018-9a7d-9c215751e0e7 req-9e8f92e3-d2d3-4d30-8eb6-44aee3ac3620 tempest-AttachVolumeNegativeTest-1177918499 None] Deleting attachment 3e5570a1-8078-4158-89df-589cad70770a. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:25:13 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8bfc78dc-c230-4317-9dea-c40be050ef60" returned: 0 in 0.656s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-quobyte-8bfc78dc-c230-4317-9dea-c40be050ef60" released by "delete_volume" :: held 1.459s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Created reservations ['d1a0d11b-7c15-44d1-9bc8-af56cc9b80f2', 'e9d314a0-54a0-40b2-9868-9209354ee6f6', 'a268a715-8fe8-4ad7-ad9c-1a6723b8c6d0', 'dd75e96b-2236-4f0f-ba80-0046d513a5f5'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:13 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:13 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:14 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:14 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Deleted volume successfully. Jul 07 08:25:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-418eec69-9f34-433e-8773-961b865c8cf6 tempest-VolumesDeleteCascade-530446556 None] Lock "cinder-8bfc78dc-c230-4317-9dea-c40be050ef60-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Flow 'volume_create_manager' (bfc3faff-29d0-4fa5-ae51-6355c4f997aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de742102-73ff-4523-bf42-81e6912641f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de742102-73ff-4523-bf42-81e6912641f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1399869972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15247ce-25ea-49d4-82f0-e09130fb8fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e915de361a48b5a3c5e59737c93dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:17Z,use_quota=True,user_id='df4c5bb35a3d4a8fbf538237c68715cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229a1851-8ce8-4204-ab46-bed5ded40ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229a1851-8ce8-4204-ab46-bed5ded40ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9eeb582-62ed-4018-88f6-423e82cb2baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9eeb582-62ed-4018-88f6-423e82cb2baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15247ce-25ea-49d4-82f0-e09130fb8fc9', 'volume_name': 'volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fb0be8-1b1b-4936-b5df-09040b668498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fb0be8-1b1b-4936-b5df-09040b668498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427b1068-5687-4220-89bf-e42e53d5b0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:17 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Volume f15247ce-25ea-49d4-82f0-e09130fb8fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9', 'volume_size': 1} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1399869972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15247ce-25ea-49d4-82f0-e09130fb8fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e915de361a48b5a3c5e59737c93dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:17Z,use_quota=True,user_id='df4c5bb35a3d4a8fbf538237c68715cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Creating volume f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:17 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:25:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:17 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 1073741824 Jul 07 08:25:17 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:18 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 1073741824" returned: 0 in 0.927s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:18 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 Jul 07 08:25:18 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:19 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9" returned: 0 in 0.642s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427b1068-5687-4220-89bf-e42e53d5b0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598664c4-4a9a-454c-bb8a-d46545d73d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:19 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Volume volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 (f15247ce-25ea-49d4-82f0-e09130fb8fc9): created successfully Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598664c4-4a9a-454c-bb8a-d46545d73d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Flow 'volume_create_manager' (bfc3faff-29d0-4fa5-ae51-6355c4f997aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:19 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-89ef4871-0409-4b0c-b162-350c210f1b92 tempest-VolumesCloneTest-1222083841 None] Created volume successfully. Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Flow 'volume_create_manager' (e9bd8062-7ca2-48da-b39c-e101f5895d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da133d4-f069-477c-a145-07a7f81a7fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da133d4-f069-477c-a145-07a7f81a7fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-385552274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6510f2e0-ec4a-46d1-96f7-09f255532921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e915de361a48b5a3c5e59737c93dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f15247ce-25ea-49d4-82f0-e09130fb8fc9,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:20Z,use_quota=True,user_id='df4c5bb35a3d4a8fbf538237c68715cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47692308-c3f5-4da1-9155-e06baa45c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47692308-c3f5-4da1-9155-e06baa45c925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cffab3a-b6a7-444f-b8e8-79e19b7ac266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cffab3a-b6a7-444f-b8e8-79e19b7ac266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6510f2e0-ec4a-46d1-96f7-09f255532921', 'volume_name': 'volume-6510f2e0-ec4a-46d1-96f7-09f255532921', 'volume_size': 2, 'source_volid': 'f15247ce-25ea-49d4-82f0-e09130fb8fc9', 'source_volstatus': 'available'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a41fc86-1360-4925-8c73-ab59bc9a4155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a41fc86-1360-4925-8c73-ab59bc9a4155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35962ac2-46b9-4449-91da-fe6a92b69349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:19 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Volume 6510f2e0-ec4a-46d1-96f7-09f255532921: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6510f2e0-ec4a-46d1-96f7-09f255532921', 'volume_size': 2, 'source_volid': 'f15247ce-25ea-49d4-82f0-e09130fb8fc9', 'source_volstatus': 'available'} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:19 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Cloning volume f15247ce-25ea-49d4-82f0-e09130fb8fc9 to volume 6510f2e0-ec4a-46d1-96f7-09f255532921 Jul 07 08:25:20 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Creating offline snapshot 3d602e19-b457-44d5-8b89-aa9ba9f9a0bd of volume f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:25:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[44950e1b-8d76-427b-8fb2-25a23868400e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:20 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 Jul 07 08:25:20 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:20 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9" returned: 0 in 0.818s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:20 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd 1G Jul 07 08:25:20 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:21 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd 1G" returned: 0 in 0.797s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:21 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd Jul 07 08:25:21 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:22 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd" returned: 0 in 0.711s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:22 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd is being set with open permissions: ugo+rw Jul 07 08:25:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:22 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd Jul 07 08:25:22 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:23 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd" returned: 0 in 0.676s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:23 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.info Jul 07 08:25:23 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:23 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.info" returned: 0 in 0.740s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:23 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.info is being set with open permissions: ugo+rw Jul 07 08:25:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:23 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.info Jul 07 08:25:23 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "cinder-c524f6b6-f27d-4147-9d0b-940130a89b0e-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-c524f6b6-f27d-4147-9d0b-940130a89b0e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "cinder-quobyte-c524f6b6-f27d-4147-9d0b-940130a89b0e" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-quobyte-c524f6b6-f27d-4147-9d0b-940130a89b0e" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e92a447-3bca-4e23-a2fb-45cc92b4d513]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:24 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e Jul 07 08:25:24 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:24 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.info" returned: 0 in 0.696s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Acquiring lock "cinder-quobyte-6510f2e0-ec4a-46d1-96f7-09f255532921" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Lock "cinder-quobyte-6510f2e0-ec4a-46d1-96f7-09f255532921" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] snapshot: 3d602e19-b457-44d5-8b89-aa9ba9f9a0bd, volume: 6510f2e0-ec4a-46d1-96f7-09f255532921, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[da88ba94-d5c9-41b6-b049-17f860124733]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:24 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd Jul 07 08:25:24 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:25 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e" returned: 0 in 0.820s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:25 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e Jul 07 08:25:25 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:25 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd" returned: 0 in 0.803s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7674fa7-f21c-4b10-8146-456c7a8d3ea9]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:25 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 Jul 07 08:25:25 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:25 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c524f6b6-f27d-4147-9d0b-940130a89b0e" returned: 0 in 0.684s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-quobyte-c524f6b6-f27d-4147-9d0b-940130a89b0e" released by "delete_volume" :: held 1.551s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Created reservations ['7bb8ecae-fa1c-427d-8393-1d5177b39fe9', '0179ac34-6657-46c5-9b80-f7d4a559fc16', 'ff102b81-0da9-4b45-84f1-d5b130435656', '4ff99c4c-919d-4825-8c94-7bc3e4ec8b72'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:25 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:25 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:26 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9" returned: 0 in 0.744s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:26 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 Jul 07 08:25:26 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "cinder-43c500db-be84-46cc-bea8-fba110924f7e-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-43c500db-be84-46cc-bea8-fba110924f7e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "cinder-quobyte-43c500db-be84-46cc-bea8-fba110924f7e" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-quobyte-43c500db-be84-46cc-bea8-fba110924f7e" acquired by "delete_volume" :: waited 0.032s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:26 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.701s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Deleted volume successfully. Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[af01217b-5160-4251-891f-3b80df7b2898]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-fa42d564-a193-497a-b9be-4fd0199a9836 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-c524f6b6-f27d-4147-9d0b-940130a89b0e-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:26 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e Jul 07 08:25:26 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:27 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e" returned: 0 in 1.169s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:27 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e Jul 07 08:25:27 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:29 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-43c500db-be84-46cc-bea8-fba110924f7e" returned: 0 in 1.336s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-quobyte-43c500db-be84-46cc-bea8-fba110924f7e" released by "delete_volume" :: held 2.572s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:29 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Created reservations ['c183fe6c-f52b-4bf7-9f50-cff752f1a9c5', '23d30c29-75d8-4a73-8a49-73c66bf00310', '348c90f6-cda2-486f-bbef-bd362981ef33', 'a9c2f9b2-ff21-4162-baa8-67c11aba746f'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:29 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:29 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "cinder-f7d6189f-a54b-4911-bb37-53447e55353f-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:30 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.391s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:30 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:30 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Deleted volume successfully. Jul 07 08:25:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-f7d6189f-a54b-4911-bb37-53447e55353f-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7f82363b-bc7c-4938-b030-c1c9888323fb tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-43c500db-be84-46cc-bea8-fba110924f7e-delete_volume" released by "delete_volume" :: held 4.404s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "cinder-quobyte-f7d6189f-a54b-4911-bb37-53447e55353f" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-quobyte-f7d6189f-a54b-4911-bb37-53447e55353f" acquired by "delete_volume" :: waited 0.031s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdaa3bd-6823-4bc3-bc62-e722c515f3ad]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:31 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f Jul 07 08:25:31 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:31 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921" returned: 0 in 5.097s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6daab9-f694-4a2f-b233-e04276742e90]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:31 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 Jul 07 08:25:31 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:31 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f" returned: 0 in 0.744s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:31 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f Jul 07 08:25:31 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:32 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9" returned: 0 in 0.909s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:25:32 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Converted 1024.00 MB image at 200.87 MB/s Jul 07 08:25:32 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 is being set with open permissions: ugo+rw Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:32 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 Jul 07 08:25:32 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:32 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f7d6189f-a54b-4911-bb37-53447e55353f" returned: 0 in 0.612s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-quobyte-f7d6189f-a54b-4911-bb37-53447e55353f" released by "delete_volume" :: held 1.403s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Created reservations ['a79f99d3-2123-455a-a744-e14884652ca4', '546f52a5-655b-4c04-a7ef-fae6c3242c9f', '6e737af1-b4fa-4aa8-bac5-cdffe05ac26d', '793b2d35-9e9c-45ac-836f-98e5f90c4c23'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:32 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:32 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:32 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921" returned: 0 in 0.644s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Lock "cinder-quobyte-6510f2e0-ec4a-46d1-96f7-09f255532921" released by "_copy_volume_from_snapshot" :: held 8.277s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Acquiring lock "cinder-quobyte-3d602e19-b457-44d5-8b89-aa9ba9f9a0bd" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Lock "cinder-quobyte-3d602e19-b457-44d5-8b89-aa9ba9f9a0bd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Deleting offline snapshot 3d602e19-b457-44d5-8b89-aa9ba9f9a0bd of volume f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] snapshot_file for this snap is: volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ebd88d-7d7d-407d-b0d9-1b733f5e0b17]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:33 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd Jul 07 08:25:33 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:33 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.625s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:33 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Deleted volume successfully. Jul 07 08:25:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7135f120-522a-41aa-abfd-2aff2f980dc5 tempest-AttachVolumeNegativeTest-1177918499 None] Lock "cinder-f7d6189f-a54b-4911-bb37-53447e55353f-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:33 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd" returned: 0 in 0.776s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:25:33 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da7217b-3861-4c58-9210-e68660dc6b8f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:33 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 Jul 07 08:25:33 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:34 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9" returned: 0 in 0.793s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:34 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd Jul 07 08:25:34 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:35 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd" returned: 0 in 0.764s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:35 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd Jul 07 08:25:35 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:35 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9.3d602e19-b457-44d5-8b89-aa9ba9f9a0bd" returned: 0 in 0.630s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Lock "cinder-quobyte-3d602e19-b457-44d5-8b89-aa9ba9f9a0bd" released by "_delete_snapshot" :: held 3.060s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.982s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35962ac2-46b9-4449-91da-fe6a92b69349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6510f2e0-ec4a-46d1-96f7-09f255532921', 'volume_size': 2, 'source_volid': 'f15247ce-25ea-49d4-82f0-e09130fb8fc9', 'source_volstatus': 'available'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a95501-9eac-49c0-89e2-af6d44534e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:36 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Volume volume-6510f2e0-ec4a-46d1-96f7-09f255532921 (6510f2e0-ec4a-46d1-96f7-09f255532921): created successfully Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a95501-9eac-49c0-89e2-af6d44534e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Flow 'volume_create_manager' (e9bd8062-7ca2-48da-b39c-e101f5895d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e9cfef71-2e8c-4ca6-abc8-aa3d4174de1a tempest-VolumesCloneTest-1222083841 None] Created volume successfully. Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Acquiring lock "cinder-6510f2e0-ec4a-46d1-96f7-09f255532921-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Lock "cinder-6510f2e0-ec4a-46d1-96f7-09f255532921-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=77,cinder:INSERT=20,cinder:UPDATE=80,cinder:DELETE=6 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Acquiring lock "cinder-quobyte-6510f2e0-ec4a-46d1-96f7-09f255532921" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Lock "cinder-quobyte-6510f2e0-ec4a-46d1-96f7-09f255532921" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94bf78b-629a-42c5-b5e5-af309905beaf]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:36 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 Jul 07 08:25:36 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:37 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921" returned: 0 in 0.805s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:37 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921 Jul 07 08:25:37 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:38 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6510f2e0-ec4a-46d1-96f7-09f255532921" returned: 0 in 0.677s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Lock "cinder-quobyte-6510f2e0-ec4a-46d1-96f7-09f255532921" released by "delete_volume" :: held 1.534s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Created reservations ['b96c30c1-7d36-4edc-8a35-da62415ddeba', 'bfb7d334-3896-49bf-8a95-84150b743e9e', '787812e0-578e-49f6-b787-b227a9d77d49', 'fed10774-20d1-4c56-b923-f19fc7e67899'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:38 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:38 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Acquiring lock "cinder-f15247ce-25ea-49d4-82f0-e09130fb8fc9-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Lock "cinder-f15247ce-25ea-49d4-82f0-e09130fb8fc9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Acquiring lock "cinder-quobyte-f15247ce-25ea-49d4-82f0-e09130fb8fc9" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Lock "cinder-quobyte-f15247ce-25ea-49d4-82f0-e09130fb8fc9" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e58caa-4965-4b9d-86b0-1cf1a8ad7dff]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:38 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.734s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:38 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Deleted volume successfully. Jul 07 08:25:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f25f67ee-eeae-497f-8e0f-be2796799f8b tempest-VolumesCloneTest-1222083841 None] Lock "cinder-6510f2e0-ec4a-46d1-96f7-09f255532921-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:39 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 Jul 07 08:25:39 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:39 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9" returned: 0 in 0.795s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:39 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9 Jul 07 08:25:39 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:40 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f15247ce-25ea-49d4-82f0-e09130fb8fc9" returned: 0 in 0.671s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Lock "cinder-quobyte-f15247ce-25ea-49d4-82f0-e09130fb8fc9" released by "delete_volume" :: held 1.538s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Created reservations ['79df45a4-9d2f-4993-8aab-92b17396683a', 'ba9a5d12-a60f-4f31-a486-3e095e08e1f6', 'a492f26f-2a8c-40a6-b848-59ee32c8110b', 'd24b00c3-83df-4871-b288-3cac5083708f'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Flow 'volume_create_manager' (977b32b3-bb3c-462c-9d80-abe73ca040e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5b56dc-0860-4017-a176-80871acd1b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5b56dc-0860-4017-a176-80871acd1b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-519245423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5760bf00-c6ae-4fc5-8e8a-14a67e390cc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b35c68f5a2d4ec0849a94798d71bb63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:40Z,use_quota=True,user_id='77ef5f88600b43d38384f3ef3686b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9964a3d-5976-42de-a9ad-6612155b39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9964a3d-5976-42de-a9ad-6612155b39ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51ad5f1-6eb5-49f9-a517-3bccae8bfbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51ad5f1-6eb5-49f9-a517-3bccae8bfbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5760bf00-c6ae-4fc5-8e8a-14a67e390cc9', 'volume_name': 'volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfa3fd2-64cd-455f-80a5-b974d9ef695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfa3fd2-64cd-455f-80a5-b974d9ef695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a20491-f932-4f12-b8f0-425abf49f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:40 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Volume 5760bf00-c6ae-4fc5-8e8a-14a67e390cc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9', 'volume_size': 1} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-519245423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5760bf00-c6ae-4fc5-8e8a-14a67e390cc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b35c68f5a2d4ec0849a94798d71bb63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:40Z,use_quota=True,user_id='77ef5f88600b43d38384f3ef3686b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Creating volume 5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:40 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:40 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 1073741824 Jul 07 08:25:40 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:40 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:40 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:41 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.686s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:41 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:41 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Deleted volume successfully. Jul 07 08:25:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-957184f6-3193-43e4-beb3-b0315a1f189c tempest-VolumesCloneTest-1222083841 None] Lock "cinder-f15247ce-25ea-49d4-82f0-e09130fb8fc9-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:41 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 1073741824" returned: 0 in 0.879s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:41 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 Jul 07 08:25:41 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:42 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9" returned: 0 in 0.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a20491-f932-4f12-b8f0-425abf49f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe34113-7179-4167-9ea4-8f01fc562123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:42 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Volume volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 (5760bf00-c6ae-4fc5-8e8a-14a67e390cc9): created successfully Jul 07 08:25:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe34113-7179-4167-9ea4-8f01fc562123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Flow 'volume_create_manager' (977b32b3-bb3c-462c-9d80-abe73ca040e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:42 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-be44549d-7402-4175-ba71-0dd8a9aac084 tempest-VolumesTestJSON-1326639649 None] Created volume successfully. Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Flow 'volume_create_manager' (3faabe86-a199-49ea-8aec-f142d4fccebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ab28ac-f76d-455b-9c10-f9ea279d54ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ab28ac-f76d-455b-9c10-f9ea279d54ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1585284057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1dfca50-87c3-4352-bc87-136dd1e212b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b35c68f5a2d4ec0849a94798d71bb63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:43Z,use_quota=True,user_id='77ef5f88600b43d38384f3ef3686b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140586bc-f828-40c7-ac2a-ef2b4f9513da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140586bc-f828-40c7-ac2a-ef2b4f9513da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec4007d-29ef-497f-a0c8-84052778f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec4007d-29ef-497f-a0c8-84052778f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1dfca50-87c3-4352-bc87-136dd1e212b9', 'volume_name': 'volume-e1dfca50-87c3-4352-bc87-136dd1e212b9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077d1697-6834-420a-b25d-c35e8867f790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077d1697-6834-420a-b25d-c35e8867f790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba799ad-f7ee-4397-949d-02711ba1b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:43 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Volume e1dfca50-87c3-4352-bc87-136dd1e212b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1dfca50-87c3-4352-bc87-136dd1e212b9', 'volume_size': 1} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1585284057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1dfca50-87c3-4352-bc87-136dd1e212b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b35c68f5a2d4ec0849a94798d71bb63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:43Z,use_quota=True,user_id='77ef5f88600b43d38384f3ef3686b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Creating volume e1dfca50-87c3-4352-bc87-136dd1e212b9 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:43 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:43 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 1073741824 Jul 07 08:25:43 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=106,cinder:SELECT=77,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Flow 'volume_create_manager' (2cdad56c-ed57-4a3c-ac52-62d2cab439e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c7e016-5130-4b02-8c0a-0ae6e99aba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c7e016-5130-4b02-8c0a-0ae6e99aba70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-785092650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4893228a3c5e4e54a008d46891d6d803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:44Z,use_quota=True,user_id='d92d1bac25fe4a7aa9c37ef8d599edec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9299fd-4b27-4a6a-bd66-632ed29b119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9299fd-4b27-4a6a-bd66-632ed29b119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a943438-9095-4ce2-b6f3-6c90f5c031fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a943438-9095-4ce2-b6f3-6c90f5c031fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91', 'volume_name': 'volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91', 'volume_size': 2}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343b3407-6d51-4f4e-87e6-031deec9ea0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343b3407-6d51-4f4e-87e6-031deec9ea0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410e9fc2-cdff-436f-abe3-42a2196eff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Volume 65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91', 'volume_size': 2} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:44 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 1073741824" returned: 0 in 0.859s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:44 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 Jul 07 08:25:44 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:44 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9" returned: 0 in 0.598s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-785092650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4893228a3c5e4e54a008d46891d6d803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:44Z,use_quota=True,user_id='d92d1bac25fe4a7aa9c37ef8d599edec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Creating volume 65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:44 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 2147483648 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba799ad-f7ee-4397-949d-02711ba1b955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1dfca50-87c3-4352-bc87-136dd1e212b9', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 2147483648 Jul 07 08:25:44 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799c3f49-43d3-4f7b-86c5-b46d7a79ce58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:44 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Volume volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 (e1dfca50-87c3-4352-bc87-136dd1e212b9): created successfully Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799c3f49-43d3-4f7b-86c5-b46d7a79ce58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Flow 'volume_create_manager' (3faabe86-a199-49ea-8aec-f142d4fccebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:44 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-98f6d4c6-2e99-407f-bf8d-833ec76c2cc3 tempest-VolumesTestJSON-1326639649 None] Created volume successfully. Jul 07 08:25:45 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 2147483648" returned: 0 in 0.941s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Flow 'volume_create_manager' (09d30ddf-26f8-412f-95c8-ae14d16cdd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96c3d58-2ab5-4834-a06b-3effe37f3efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96c3d58-2ab5-4834-a06b-3effe37f3efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2135977963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c502719-5052-4565-b9b1-5c59d09bcf15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b35c68f5a2d4ec0849a94798d71bb63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:46Z,use_quota=True,user_id='77ef5f88600b43d38384f3ef3686b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb5babd-10ff-4b17-8caa-713dcfee6027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 Jul 07 08:25:45 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb5babd-10ff-4b17-8caa-713dcfee6027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa8890a-b4cd-4042-81f6-078941e1d2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa8890a-b4cd-4042-81f6-078941e1d2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c502719-5052-4565-b9b1-5c59d09bcf15', 'volume_name': 'volume-9c502719-5052-4565-b9b1-5c59d09bcf15', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef09f66-1cdf-4fad-9381-613e5b74bc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef09f66-1cdf-4fad-9381-613e5b74bc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f6d65a-2051-4e74-b01d-dcdb2ce1f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:45 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Volume 9c502719-5052-4565-b9b1-5c59d09bcf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c502719-5052-4565-b9b1-5c59d09bcf15', 'volume_size': 1} Jul 07 08:25:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:46 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91" returned: 0 in 0.634s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2135977963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c502719-5052-4565-b9b1-5c59d09bcf15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9b35c68f5a2d4ec0849a94798d71bb63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:46Z,use_quota=True,user_id='77ef5f88600b43d38384f3ef3686b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Creating volume 9c502719-5052-4565-b9b1-5c59d09bcf15 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:46 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410e9fc2-cdff-436f-abe3-42a2196eff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91', 'volume_size': 2}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:46 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15 1073741824 Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4351273c-1c2e-4ddd-bd1d-4d1bdcc8c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:46 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:46 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Volume volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 (65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91): created successfully Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4351273c-1c2e-4ddd-bd1d-4d1bdcc8c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Flow 'volume_create_manager' (2cdad56c-ed57-4a3c-ac52-62d2cab439e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:46 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1276e713-473e-46f7-afcd-b1fb96888277 tempest-VolumesCloneNegativeTest-770770594 None] Created volume successfully. Jul 07 08:25:47 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15 1073741824" returned: 0 in 0.787s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Acquiring lock "cinder-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Lock "cinder-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:47 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15 Jul 07 08:25:47 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Acquiring lock "cinder-quobyte-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Lock "cinder-quobyte-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a92c1b-610a-424b-a581-106994b90213]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:47 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 Jul 07 08:25:47 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:47 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15" returned: 0 in 0.647s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f6d65a-2051-4e74-b01d-dcdb2ce1f40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c502719-5052-4565-b9b1-5c59d09bcf15', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcfdc21-b5cd-44ee-a1ee-7419a2edc327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:47 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Volume volume-9c502719-5052-4565-b9b1-5c59d09bcf15 (9c502719-5052-4565-b9b1-5c59d09bcf15): created successfully Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcfdc21-b5cd-44ee-a1ee-7419a2edc327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Flow 'volume_create_manager' (09d30ddf-26f8-412f-95c8-ae14d16cdd82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-62309c91-4b39-457a-91af-f9990cd023e8 tempest-VolumesTestJSON-1326639649 None] Created volume successfully. Jul 07 08:25:48 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91" returned: 0 in 0.753s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:48 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91 Jul 07 08:25:48 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:48 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91" returned: 0 in 0.605s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Lock "cinder-quobyte-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91" released by "delete_volume" :: held 1.392s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Created reservations ['6ce64bec-11ac-4d9e-ab0f-10dcbaa07eb9', 'daa50e7e-7ff6-4dd1-ae7d-86ea3ee5f9ba', '19a314f4-e353-43e6-bd64-4a87fceaf825', '2bca7a82-1e6c-47a5-8e77-aae31549fec8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:48 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:48 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:49 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.660s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:49 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Deleted volume successfully. Jul 07 08:25:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-724d9802-2eb1-45fb-9158-ccd6efc17c4a tempest-VolumesCloneNegativeTest-770770594 None] Lock "cinder-65aa5c52-3ee2-41ea-a05d-c12d2c1b7c91-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "cinder-9c502719-5052-4565-b9b1-5c59d09bcf15-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Lock "cinder-9c502719-5052-4565-b9b1-5c59d09bcf15-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "cinder-quobyte-9c502719-5052-4565-b9b1-5c59d09bcf15" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Lock "cinder-quobyte-9c502719-5052-4565-b9b1-5c59d09bcf15" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:49 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b568c34f-6057-4975-8e1b-537083ddf31a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:49 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15 Jul 07 08:25:49 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:50 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15" returned: 0 in 0.770s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:50 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15 Jul 07 08:25:50 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:51 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9c502719-5052-4565-b9b1-5c59d09bcf15" returned: 0 in 0.645s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Lock "cinder-quobyte-9c502719-5052-4565-b9b1-5c59d09bcf15" released by "delete_volume" :: held 1.457s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Created reservations ['fe1ef805-59c7-408e-8439-c361ce00048b', '72360497-f651-4b94-afb3-b035d9640850', 'f393fbc5-3329-4270-8253-a44011ca87d5', '1020d3d0-f751-42a1-a66c-d0f4f2f03cb2'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:51 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:51 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:51 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "cinder-e1dfca50-87c3-4352-bc87-136dd1e212b9-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.636s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Deleted volume successfully. Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Lock "cinder-e1dfca50-87c3-4352-bc87-136dd1e212b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e70f8a4d-6c01-41b1-b53b-714319840874 tempest-VolumesTestJSON-1326639649 None] Lock "cinder-9c502719-5052-4565-b9b1-5c59d09bcf15-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "cinder-quobyte-e1dfca50-87c3-4352-bc87-136dd1e212b9" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Lock "cinder-quobyte-e1dfca50-87c3-4352-bc87-136dd1e212b9" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d172e-f205-4771-a977-d31add7db823]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:52 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 Jul 07 08:25:52 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Flow 'volume_create_manager' (87106ba0-4ab5-49fc-ba54-ae43b2cac8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03277bd2-6960-4677-a003-61f334b1b86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03277bd2-6960-4677-a003-61f334b1b86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1189806717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647d0d15-c3df-490c-bb57-a16260a7fd39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba933b8e296a40afbb1edd498794a11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:52Z,use_quota=True,user_id='fd7d60dc91434b1dae7d2bce16e51b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8572ffd2-ae43-4077-91b8-10375ef9c5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8572ffd2-ae43-4077-91b8-10375ef9c5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a29092-4f16-467c-9fef-853a5b61e392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a29092-4f16-467c-9fef-853a5b61e392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647d0d15-c3df-490c-bb57-a16260a7fd39', 'volume_name': 'volume-647d0d15-c3df-490c-bb57-a16260a7fd39', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b1131d-5cbd-4bde-b028-8e61829ec69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b1131d-5cbd-4bde-b028-8e61829ec69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6179242c-9b88-46c6-a66c-fb34bb8b0570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:52 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Volume 647d0d15-c3df-490c-bb57-a16260a7fd39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647d0d15-c3df-490c-bb57-a16260a7fd39', 'volume_size': 1} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1189806717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647d0d15-c3df-490c-bb57-a16260a7fd39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba933b8e296a40afbb1edd498794a11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:25:52Z,use_quota=True,user_id='fd7d60dc91434b1dae7d2bce16e51b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Creating volume 647d0d15-c3df-490c-bb57-a16260a7fd39 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:25:52 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:52 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39 1073741824 Jul 07 08:25:52 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:52 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9" returned: 0 in 0.773s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:52 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9 Jul 07 08:25:52 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:53 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39 1073741824" returned: 0 in 0.927s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:53 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39 Jul 07 08:25:53 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:53 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e1dfca50-87c3-4352-bc87-136dd1e212b9" returned: 0 in 0.717s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Lock "cinder-quobyte-e1dfca50-87c3-4352-bc87-136dd1e212b9" released by "delete_volume" :: held 1.529s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Created reservations ['07d44f17-c0cf-4c6c-8048-5a74e284ac88', '535ff4cc-d48b-4ee8-b369-2808ab44903a', 'd8437dd5-9361-4c04-95db-ca02ef3adaea', '373e37ed-ec66-4180-8ffd-eac4b25afed1'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:53 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:53 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:53 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39" returned: 0 in 0.642s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6179242c-9b88-46c6-a66c-fb34bb8b0570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647d0d15-c3df-490c-bb57-a16260a7fd39', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1183283f-ebf7-4f1e-b9c9-7a711831abc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:25:54 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Volume volume-647d0d15-c3df-490c-bb57-a16260a7fd39 (647d0d15-c3df-490c-bb57-a16260a7fd39): created successfully Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1183283f-ebf7-4f1e-b9c9-7a711831abc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Flow 'volume_create_manager' (87106ba0-4ab5-49fc-ba54-ae43b2cac8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:25:54 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-afa1b393-b1e4-4bfc-9474-9b0cd25dd755 tempest-VolumesNegativeTest-1274216360 None] Created volume successfully. Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Acquiring lock "cinder-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Lock "cinder-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Acquiring lock "cinder-quobyte-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Lock "cinder-quobyte-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4eaf84-8364-4ee7-9eca-7a647c938d33]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:54 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.708s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:54 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Deleted volume successfully. Jul 07 08:25:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-927a7142-33dc-4806-833b-273a689b9a57 tempest-VolumesTestJSON-1326639649 None] Lock "cinder-e1dfca50-87c3-4352-bc87-136dd1e212b9-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:54 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 Jul 07 08:25:54 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:55 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9" returned: 0 in 0.797s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:55 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9 Jul 07 08:25:55 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:55 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9" returned: 0 in 0.654s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Lock "cinder-quobyte-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9" released by "delete_volume" :: held 1.500s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Created reservations ['687c1188-aca3-47c7-8531-f68516fcf7a5', 'b1f2e421-4590-4d5c-a989-4926b0e01b58', 'bd50cc10-adb5-4b86-83d0-c68e82cd5574', '890afb96-fd13-47a2-a415-ad99717b4439'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:25:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:25:55 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:25:55 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:25:56 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 07 08:25:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.674s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:25:56 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:25:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Deleted volume successfully. Jul 07 08:25:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-09e26b2f-3c04-4e98-9505-ce3fb42e797b tempest-VolumesTestJSON-1326639649 None] Lock "cinder-5760bf00-c6ae-4fc5-8e8a-14a67e390cc9-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:00 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d3e4857b-ec51-496a-9f04-21180290bdad tempest-GroupSnapshotsV319Test-1123124455 None] Group tempest-GroupSnapshotsV319Test-Group-1686630526: creating Jul 07 08:26:00 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d3e4857b-ec51-496a-9f04-21180290bdad tempest-GroupSnapshotsV319Test-1123124455 None] Group tempest-GroupSnapshotsV319Test-Group-1686630526: created successfully Jul 07 08:26:00 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d3e4857b-ec51-496a-9f04-21180290bdad tempest-GroupSnapshotsV319Test-1123124455 None] Create group completed successfully. Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Flow 'volume_create_manager' (ef74abae-c113-4fdb-bbf0-1afa25caa9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea19dce-84e4-4a15-aa99-0f5cbdf5d8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea19dce-84e4-4a15-aa99-0f5cbdf5d8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451517577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36faf097-441e-4a58-80c9-d2312ccccd92,host='devstack@QuobyteHD#QuobyteHD',id=88c98c93-c4fa-4d6c-8b69-473f912bea88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5be9bc8fbf24c44aee0ca7309c71d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:02Z,use_quota=True,user_id='d70b4377e84f4743bae61333397ada5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60532509-ece6-4255-b962-52a749f7d4e1),volume_type_id=60532509-ece6-4255-b962-52a749f7d4e1)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb37dc8-9b05-4302-bb0e-4489030f556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb37dc8-9b05-4302-bb0e-4489030f556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bcef89-5406-44ca-889e-074b93e9c2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bcef89-5406-44ca-889e-074b93e9c2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c98c93-c4fa-4d6c-8b69-473f912bea88', 'volume_name': 'volume-88c98c93-c4fa-4d6c-8b69-473f912bea88', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee24d47-02e9-4dd6-9532-f2671c0df9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee24d47-02e9-4dd6-9532-f2671c0df9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f962c9-7d71-4334-bd85-adf85458515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:02 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Volume 88c98c93-c4fa-4d6c-8b69-473f912bea88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c98c93-c4fa-4d6c-8b69-473f912bea88', 'volume_size': 1} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36faf097-441e-4a58-80c9-d2312ccccd92,created_at=2026-07-07T06:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451517577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36faf097-441e-4a58-80c9-d2312ccccd92,host='devstack@QuobyteHD#QuobyteHD',id=88c98c93-c4fa-4d6c-8b69-473f912bea88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5be9bc8fbf24c44aee0ca7309c71d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:02Z,use_quota=True,user_id='d70b4377e84f4743bae61333397ada5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60532509-ece6-4255-b962-52a749f7d4e1),volume_type_id=60532509-ece6-4255-b962-52a749f7d4e1)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Creating volume 88c98c93-c4fa-4d6c-8b69-473f912bea88 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:26:02 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:02 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 1073741824 Jul 07 08:26:02 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:02 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 1073741824" returned: 0 in 0.827s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:03 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 Jul 07 08:26:03 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:03 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88" returned: 0 in 0.652s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:26:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f962c9-7d71-4334-bd85-adf85458515b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c98c93-c4fa-4d6c-8b69-473f912bea88', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2ec714-192c-4052-ab7a-f6ce1eec51b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:03 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Volume volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 (88c98c93-c4fa-4d6c-8b69-473f912bea88): created successfully Jul 07 08:26:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2ec714-192c-4052-ab7a-f6ce1eec51b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Flow 'volume_create_manager' (ef74abae-c113-4fdb-bbf0-1afa25caa9b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7c991662-9454-4711-b9e7-e85ef92d2206 tempest-GroupSnapshotsV319Test-1123124455 None] Created volume successfully. Jul 07 08:26:04 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] GroupSnapshot be848d0b-447f-492f-8544-63c3c50fc4c9: creating. Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Group snapshot be848d0b-447f-492f-8544-63c3c50fc4c9: creating. {{(pid=87179) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:04 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:26:04 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Creating offline snapshot bada5932-ea1a-465e-a010-62d8d0baaea9 of volume 88c98c93-c4fa-4d6c-8b69-473f912bea88 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cdc57a-fdfb-4f27-8d4d-4329629504b0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:04 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 Jul 07 08:26:04 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:05 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.686s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:26:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:26:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:26:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:26:05 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88" returned: 0 in 0.832s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:05 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 1G Jul 07 08:26:05 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:06 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 1G" returned: 0 in 1.080s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:06 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 Jul 07 08:26:06 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:07 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9" returned: 0 in 0.760s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:07 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:26:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:07 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 Jul 07 08:26:07 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:08 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9" returned: 0 in 0.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:08 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.info Jul 07 08:26:08 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:08 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.info" returned: 0 in 0.643s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:08 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 08:26:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:08 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.info Jul 07 08:26:08 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:09 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.info" returned: 0 in 0.635s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.688s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:09 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-cacd0b49-c0d6-4618-9daf-e3e3c658f39c tempest-GroupSnapshotsV319Test-1123124455 None] group_snapshot be848d0b-447f-492f-8544-63c3c50fc4c9: created successfully Jul 07 08:26:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] group_snapshot be848d0b-447f-492f-8544-63c3c50fc4c9: deleting Jul 07 08:26:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] group_snapshot be848d0b-447f-492f-8544-63c3c50fc4c9: deleting {{(pid=87179) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 08:26:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Acquiring lock "cinder-quobyte-88c98c93-c4fa-4d6c-8b69-473f912bea88" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "cinder-quobyte-88c98c93-c4fa-4d6c-8b69-473f912bea88" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Acquiring lock "cinder-quobyte-bada5932-ea1a-465e-a010-62d8d0baaea9" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "cinder-quobyte-bada5932-ea1a-465e-a010-62d8d0baaea9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Deleting offline snapshot bada5932-ea1a-465e-a010-62d8d0baaea9 of volume 88c98c93-c4fa-4d6c-8b69-473f912bea88 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:26:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] snapshot_file for this snap is: volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:26:10 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac81200-721b-461f-b87d-04bbd9e9d4da]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:10 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 Jul 07 08:26:10 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:11 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9" returned: 0 in 0.819s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c98c93-c4fa-4d6c-8b69-473f912bea88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:26:11 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c8c7ff-aaf2-4f0e-b5fe-0e987699c962]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:11 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 Jul 07 08:26:11 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:12 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88" returned: 0 in 0.782s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:12 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 Jul 07 08:26:12 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:12 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9" returned: 0 in 0.711s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:12 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9 Jul 07 08:26:12 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:13 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88.bada5932-ea1a-465e-a010-62d8d0baaea9" returned: 0 in 0.738s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "cinder-quobyte-bada5932-ea1a-465e-a010-62d8d0baaea9" released by "_delete_snapshot" :: held 3.199s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "cinder-quobyte-88c98c93-c4fa-4d6c-8b69-473f912bea88" released by "delete_snapshot" :: held 3.223s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:13 devstack cinder-volume[87179]: WARNING cinder.quota [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2102001928 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2102001928, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:26:13 devstack cinder-volume[87179]: WARNING cinder.quota [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2102001928 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2102001928, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:26:13 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] Created reservations ['c144306f-34cc-43f7-9544-88067551d13b', 'f1011999-2b74-4fcc-a88e-09070fa176d6', '035d958a-bdf8-46c1-8fba-81a85b5a5e8f', 'cb90c4f9-fda5-408f-8bc3-3c5b1a59df9d'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1ede269d-3494-46fe-88d6-1969384e30b5 tempest-GroupSnapshotsV319Test-1123124455 None] group_snapshot be848d0b-447f-492f-8544-63c3c50fc4c9: deleted successfully Jul 07 08:26:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Acquiring lock "cinder-quobyte-88c98c93-c4fa-4d6c-8b69-473f912bea88" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "cinder-quobyte-88c98c93-c4fa-4d6c-8b69-473f912bea88" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:14 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[be94393e-3e60-44fb-b2aa-2a159fdfe633]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:15 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 Jul 07 08:26:15 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:15 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88" returned: 0 in 0.744s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:15 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88 Jul 07 08:26:15 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:16 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-88c98c93-c4fa-4d6c-8b69-473f912bea88" returned: 0 in 0.635s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "cinder-quobyte-88c98c93-c4fa-4d6c-8b69-473f912bea88" released by "delete_volume" :: held 1.452s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Created reservations ['040b4fbf-200d-4678-a6d2-c40924ebb4b4'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:16 devstack cinder-volume[87179]: WARNING cinder.quota [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2102001928 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2102001928, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Created reservations ['33935edf-49fc-47bc-aabc-e3a8e8d5bfc8', '44b54a92-1e15-4201-932f-b551fdbafbef', 'e47f88bd-3b4f-4f7c-8b36-6408845cc847', '475d63c8-8c92-4ec2-a238-e8f6104cf145'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:16 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:26:16 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:17 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.634s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:17 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:26:17 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c1a50adf-136b-4a1f-8727-9db668e3cba2 tempest-GroupSnapshotsV319Test-1123124455 None] Delete group completed successfully. Jul 07 08:26:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-56192c1a-95c9-40fb-9fa0-58487a8aacc2 tempest-GroupsTest-2144582037 None] Group tempest-Group1-179913268: creating Jul 07 08:26:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-56192c1a-95c9-40fb-9fa0-58487a8aacc2 tempest-GroupsTest-2144582037 None] Group tempest-Group1-179913268: created successfully Jul 07 08:26:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-56192c1a-95c9-40fb-9fa0-58487a8aacc2 tempest-GroupsTest-2144582037 None] Create group completed successfully. Jul 07 08:26:23 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1bc0da7d-9fd2-4e32-a8cc-705b52acbdfe tempest-GroupsTest-2144582037 None] Group tempest-Group2-1507834007: creating Jul 07 08:26:23 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1bc0da7d-9fd2-4e32-a8cc-705b52acbdfe tempest-GroupsTest-2144582037 None] Group tempest-Group2-1507834007: created successfully Jul 07 08:26:23 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1bc0da7d-9fd2-4e32-a8cc-705b52acbdfe tempest-GroupsTest-2144582037 None] Create group completed successfully. Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Acquiring lock "cinder-647d0d15-c3df-490c-bb57-a16260a7fd39-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Lock "cinder-647d0d15-c3df-490c-bb57-a16260a7fd39-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Acquiring lock "cinder-quobyte-647d0d15-c3df-490c-bb57-a16260a7fd39" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Lock "cinder-quobyte-647d0d15-c3df-490c-bb57-a16260a7fd39" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a975a9-f961-4c69-a610-c715b43af36a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:24 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39 Jul 07 08:26:24 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Flow 'volume_create_manager' (a9e3cdf0-bec7-4453-9007-c963164a1bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d908886f-7dc3-44f1-a203-fa2b76468dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d908886f-7dc3-44f1-a203-fa2b76468dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-992956519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b733fedb-fc6b-478e-ad60-739bf7d4bfa8,host='devstack@QuobyteHD#QuobyteHD',id=830e297a-73a8-4c73-ad97-2b188a33ca40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f137e2cb4d48f89565e780b76697f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:25Z,use_quota=True,user_id='fcbbd3149bb54508b4a9e5ad269d9ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f12eb161-e470-4ddb-97e0-bf6446496115),volume_type_id=f12eb161-e470-4ddb-97e0-bf6446496115)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3b32b1-d803-49b1-9c93-da66c49a64a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3b32b1-d803-49b1-9c93-da66c49a64a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcd0086-37f9-4fae-8c86-13a541877486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcd0086-37f9-4fae-8c86-13a541877486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830e297a-73a8-4c73-ad97-2b188a33ca40', 'volume_name': 'volume-830e297a-73a8-4c73-ad97-2b188a33ca40', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6e134f-f323-44e2-8ca1-0ea563a5d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6e134f-f323-44e2-8ca1-0ea563a5d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19dccef-99fa-4dba-b3d3-8c0b16526666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:24 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Volume 830e297a-73a8-4c73-ad97-2b188a33ca40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830e297a-73a8-4c73-ad97-2b188a33ca40', 'volume_size': 1} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b733fedb-fc6b-478e-ad60-739bf7d4bfa8,created_at=2026-07-07T06:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-992956519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b733fedb-fc6b-478e-ad60-739bf7d4bfa8,host='devstack@QuobyteHD#QuobyteHD',id=830e297a-73a8-4c73-ad97-2b188a33ca40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f137e2cb4d48f89565e780b76697f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:25Z,use_quota=True,user_id='fcbbd3149bb54508b4a9e5ad269d9ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f12eb161-e470-4ddb-97e0-bf6446496115),volume_type_id=f12eb161-e470-4ddb-97e0-bf6446496115)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Creating volume 830e297a-73a8-4c73-ad97-2b188a33ca40 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:26:24 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:26:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:24 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40 1073741824 Jul 07 08:26:24 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:25 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39" returned: 0 in 0.774s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:25 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39 Jul 07 08:26:25 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:25 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40 1073741824" returned: 0 in 0.836s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:25 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40 Jul 07 08:26:25 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:26 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-647d0d15-c3df-490c-bb57-a16260a7fd39" returned: 0 in 0.704s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Lock "cinder-quobyte-647d0d15-c3df-490c-bb57-a16260a7fd39" released by "delete_volume" :: held 1.524s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Created reservations ['e326d9ee-5b18-474b-95e8-49a8d96bdd45', '82c1cad6-363d-4efc-b5e6-a558bdead955', 'fedf4a05-057c-422e-a888-d33be6d8a5d4', '5b34dd4c-8b2e-46da-a0ca-de3f17633130'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:26 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:26:26 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:26 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40" returned: 0 in 0.651s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19dccef-99fa-4dba-b3d3-8c0b16526666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830e297a-73a8-4c73-ad97-2b188a33ca40', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fb3357-a6b2-43ff-928b-284dbd4bd08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:26 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Volume volume-830e297a-73a8-4c73-ad97-2b188a33ca40 (830e297a-73a8-4c73-ad97-2b188a33ca40): created successfully Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fb3357-a6b2-43ff-928b-284dbd4bd08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Flow 'volume_create_manager' (a9e3cdf0-bec7-4453-9007-c963164a1bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-320df0c9-3f4c-4f91-9fae-7ab10de91411 tempest-GroupsTest-2144582037 None] Created volume successfully. Jul 07 08:26:26 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.669s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:26:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Deleted volume successfully. Jul 07 08:26:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c4c7cd7-a6e5-4fb0-8e2a-610da75b6c7d tempest-VolumesNegativeTest-1274216360 None] Lock "cinder-647d0d15-c3df-490c-bb57-a16260a7fd39-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Acquiring lock "cinder-quobyte-830e297a-73a8-4c73-ad97-2b188a33ca40" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Lock "cinder-quobyte-830e297a-73a8-4c73-ad97-2b188a33ca40" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7959f56-6d27-4fd5-8902-d35d474fe685]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:27 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40 Jul 07 08:26:27 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:28 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40" returned: 0 in 0.783s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:28 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40 Jul 07 08:26:28 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:29 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-830e297a-73a8-4c73-ad97-2b188a33ca40" returned: 0 in 0.658s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Lock "cinder-quobyte-830e297a-73a8-4c73-ad97-2b188a33ca40" released by "delete_volume" :: held 1.491s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Created reservations ['271f63f1-318a-48dd-919b-ad68f0371a9a'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:29 devstack cinder-volume[87179]: WARNING cinder.quota [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-327653930 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-327653930, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:26:29 devstack cinder-volume[87179]: WARNING cinder.quota [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-327653930 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-327653930, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Created reservations ['a33d2fac-ed83-4b7d-9ce4-4ac5eb05ae82', 'b86ec1a8-64a0-477a-b953-ae8e5da996b5', '7c82bde2-bbcb-41cc-a7f6-8e7e11d2e403', '9c607700-4882-4c5d-9ed8-f36372bfae59'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:29 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:26:29 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:30 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.722s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:26:30 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8a97cc07-490e-4039-8de9-78525482956b tempest-GroupsTest-2144582037 None] Delete group completed successfully. Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] Created reservations ['bd9b321e-42be-4742-8187-07df101c7bb8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:30 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:26:30 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:30 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.689s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:30 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:26:30 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-572f73f0-3bc4-4004-b740-709102d76afc tempest-GroupsTest-2144582037 None] Delete group completed successfully. Jul 07 08:26:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-26dd2c38-4f72-4175-991c-7d1bb3b98bb3 tempest-GroupsTest-2144582037 None] Group tempest-GroupsTest-Group-848855216: creating Jul 07 08:26:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-26dd2c38-4f72-4175-991c-7d1bb3b98bb3 tempest-GroupsTest-2144582037 None] Group tempest-GroupsTest-Group-848855216: created successfully Jul 07 08:26:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-26dd2c38-4f72-4175-991c-7d1bb3b98bb3 tempest-GroupsTest-2144582037 None] Create group completed successfully. Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Flow 'volume_create_manager' (7229d85c-d300-4d1b-84fc-1e764a19c6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe8c781-78db-41bb-9c0a-4c5c5ad3d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe8c781-78db-41bb-9c0a-4c5c5ad3d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1561433714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9c6dea-cfc2-435b-96a1-b7a80203cc8c,host='devstack@QuobyteHD#QuobyteHD',id=80456f4d-ce63-4821-925b-cdd5d2c24648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f137e2cb4d48f89565e780b76697f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:33Z,use_quota=True,user_id='fcbbd3149bb54508b4a9e5ad269d9ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2482237b-2c30-4c87-8d2b-6091068ee8c9),volume_type_id=2482237b-2c30-4c87-8d2b-6091068ee8c9)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926367d8-d5a1-48cb-afb1-875e9bde1229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926367d8-d5a1-48cb-afb1-875e9bde1229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a56e8fe-7552-4596-8220-9b91219d11e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a56e8fe-7552-4596-8220-9b91219d11e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80456f4d-ce63-4821-925b-cdd5d2c24648', 'volume_name': 'volume-80456f4d-ce63-4821-925b-cdd5d2c24648', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739ef980-7c89-4a34-9492-61a8cafb28a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739ef980-7c89-4a34-9492-61a8cafb28a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abf191d-52b6-4138-8538-e34cd79e5194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Volume 80456f4d-ce63-4821-925b-cdd5d2c24648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80456f4d-ce63-4821-925b-cdd5d2c24648', 'volume_size': 1} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa9c6dea-cfc2-435b-96a1-b7a80203cc8c,created_at=2026-07-07T06:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1561433714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9c6dea-cfc2-435b-96a1-b7a80203cc8c,host='devstack@QuobyteHD#QuobyteHD',id=80456f4d-ce63-4821-925b-cdd5d2c24648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f137e2cb4d48f89565e780b76697f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:33Z,use_quota=True,user_id='fcbbd3149bb54508b4a9e5ad269d9ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2482237b-2c30-4c87-8d2b-6091068ee8c9),volume_type_id=2482237b-2c30-4c87-8d2b-6091068ee8c9)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Creating volume 80456f4d-ce63-4821-925b-cdd5d2c24648 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:26:33 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:26:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:33 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648 1073741824 Jul 07 08:26:33 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:34 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648 1073741824" returned: 0 in 0.966s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:34 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648 Jul 07 08:26:34 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:35 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648" returned: 0 in 0.755s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:26:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5abf191d-52b6-4138-8538-e34cd79e5194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80456f4d-ce63-4821-925b-cdd5d2c24648', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e958f25-5c33-47ea-aa75-5f706c9e26d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Volume volume-80456f4d-ce63-4821-925b-cdd5d2c24648 (80456f4d-ce63-4821-925b-cdd5d2c24648): created successfully Jul 07 08:26:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e958f25-5c33-47ea-aa75-5f706c9e26d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Flow 'volume_create_manager' (7229d85c-d300-4d1b-84fc-1e764a19c6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:35 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-13e29d90-498c-4b51-9062-d5f158517e20 tempest-GroupsTest-2144582037 None] Created volume successfully. Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Flow 'volume_create_manager' (853580a4-c244-4dc7-9bc7-a49a81ccf51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ea9d9e-c63d-49c7-b98f-1397d3a86930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=85,cinder:INSERT=28,cinder:UPDATE=112,cinder:DELETE=7 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ea9d9e-c63d-49c7-b98f-1397d3a86930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528651430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9c6dea-cfc2-435b-96a1-b7a80203cc8c,host='devstack@QuobyteHD#QuobyteHD',id=2e59326b-bfa5-4f6f-aed6-30209a3b37c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f137e2cb4d48f89565e780b76697f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:37Z,use_quota=True,user_id='fcbbd3149bb54508b4a9e5ad269d9ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2482237b-2c30-4c87-8d2b-6091068ee8c9),volume_type_id=2482237b-2c30-4c87-8d2b-6091068ee8c9)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a779ea36-74ce-429d-bc12-6d3000cf8b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a779ea36-74ce-429d-bc12-6d3000cf8b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d07197-4abc-43b6-b168-a441309e0391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d07197-4abc-43b6-b168-a441309e0391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e59326b-bfa5-4f6f-aed6-30209a3b37c8', 'volume_name': 'volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6941df2-2b39-481e-8134-5335b2c43003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6941df2-2b39-481e-8134-5335b2c43003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19308cd-3737-494a-a24b-67c0e48e0e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:36 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Volume 2e59326b-bfa5-4f6f-aed6-30209a3b37c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8', 'volume_size': 1} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa9c6dea-cfc2-435b-96a1-b7a80203cc8c,created_at=2026-07-07T06:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528651430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9c6dea-cfc2-435b-96a1-b7a80203cc8c,host='devstack@QuobyteHD#QuobyteHD',id=2e59326b-bfa5-4f6f-aed6-30209a3b37c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f137e2cb4d48f89565e780b76697f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:37Z,use_quota=True,user_id='fcbbd3149bb54508b4a9e5ad269d9ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2482237b-2c30-4c87-8d2b-6091068ee8c9),volume_type_id=2482237b-2c30-4c87-8d2b-6091068ee8c9)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Creating volume 2e59326b-bfa5-4f6f-aed6-30209a3b37c8 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:26:36 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:26:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:36 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 1073741824 Jul 07 08:26:36 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:37 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 1073741824" returned: 0 in 0.880s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (646621fc-027a-4c55-abed-a3205756c1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd9d7a7-351d-476e-93bd-e7b36f8e5d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd9d7a7-351d-476e-93bd-e7b36f8e5d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1589036726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535f37d7-97fa-4f3e-84c7-be97fca1bef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28072c1ff73c4825ab384e627042658b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:38Z,use_quota=True,user_id='5e6d7ba7ee3f4218ab3692806873a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:37 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 Jul 07 08:26:37 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84db831-f458-41c8-b652-6aebac09cbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84db831-f458-41c8-b652-6aebac09cbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3391a1e3-3e9d-4005-9ec2-e0c4106230f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3391a1e3-3e9d-4005-9ec2-e0c4106230f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535f37d7-97fa-4f3e-84c7-be97fca1bef8', 'volume_name': 'volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5815bf86-3a49-40d8-98be-de0c756aa331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5815bf86-3a49-40d8-98be-de0c756aa331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16edbd66-1385-4c2d-9370-4e6cc5decf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:37 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Volume 535f37d7-97fa-4f3e-84c7-be97fca1bef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8', 'volume_size': 1} Jul 07 08:26:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:38 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8" returned: 0 in 0.643s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1589036726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535f37d7-97fa-4f3e-84c7-be97fca1bef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28072c1ff73c4825ab384e627042658b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:38Z,use_quota=True,user_id='5e6d7ba7ee3f4218ab3692806873a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Creating volume 535f37d7-97fa-4f3e-84c7-be97fca1bef8 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:26:38 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19308cd-3737-494a-a24b-67c0e48e0e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:38 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 1073741824 Jul 07 08:26:38 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb8cd30-ce69-4385-b364-c91d16278718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:38 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Volume volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 (2e59326b-bfa5-4f6f-aed6-30209a3b37c8): created successfully Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb8cd30-ce69-4385-b364-c91d16278718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Flow 'volume_create_manager' (853580a4-c244-4dc7-9bc7-a49a81ccf51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ec17c96e-bf04-4c53-84b6-9f8478b689de tempest-GroupsTest-2144582037 None] Created volume successfully. Jul 07 08:26:39 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4306a337-f5a0-4ead-ba37-39ca0b7863dd tempest-GroupsTest-2144582037 None] Update group completed successfully. Jul 07 08:26:39 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 1073741824" returned: 0 in 0.803s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:39 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 Jul 07 08:26:39 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:39 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8" returned: 0 in 0.619s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:26:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16edbd66-1385-4c2d-9370-4e6cc5decf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da06a0a-5d0d-49d3-8b7f-4cf739705558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:39 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Volume volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 (535f37d7-97fa-4f3e-84c7-be97fca1bef8): created successfully Jul 07 08:26:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da06a0a-5d0d-49d3-8b7f-4cf739705558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (646621fc-027a-4c55-abed-a3205756c1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:39 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-052d7009-4d0e-423b-83c6-f065e4e35137 tempest-VolumesSnapshotTestJSON-621817257 None] Created volume successfully. Jul 07 08:26:40 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ad14bbd0-7831-4f64-b6d4-d01381707c24 tempest-GroupsTest-2144582037 None] Update group completed successfully. Jul 07 08:26:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Creating offline snapshot c700e128-9d82-4bf4-b2d9-cc76912e073c of volume 535f37d7-97fa-4f3e-84c7-be97fca1bef8 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:26:41 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e2caad-84f4-498f-8552-0f0a1c06b9c0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:41 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 Jul 07 08:26:41 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:41 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8" returned: 0 in 0.742s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:41 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c 1G Jul 07 08:26:41 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Acquiring lock "cinder-quobyte-2e59326b-bfa5-4f6f-aed6-30209a3b37c8" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Lock "cinder-quobyte-2e59326b-bfa5-4f6f-aed6-30209a3b37c8" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:42 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edbadbd-c242-4d36-a56b-3ffd06cb03ae]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:42 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 Jul 07 08:26:42 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:42 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c 1G" returned: 0 in 0.839s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:42 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c Jul 07 08:26:42 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:42 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8" returned: 0 in 0.761s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:42 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8 Jul 07 08:26:42 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:43 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c" returned: 0 in 0.687s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:43 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c is being set with open permissions: ugo+rw Jul 07 08:26:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:43 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c Jul 07 08:26:43 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:43 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2e59326b-bfa5-4f6f-aed6-30209a3b37c8" returned: 0 in 0.638s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Lock "cinder-quobyte-2e59326b-bfa5-4f6f-aed6-30209a3b37c8" released by "delete_volume" :: held 1.451s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Acquiring lock "cinder-quobyte-80456f4d-ce63-4821-925b-cdd5d2c24648" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Lock "cinder-quobyte-80456f4d-ce63-4821-925b-cdd5d2c24648" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:43 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ae95c6-eccd-41ac-8d2b-62d09f0c4da6]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:43 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648 Jul 07 08:26:43 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:43 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c" returned: 0 in 0.638s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:44 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.info Jul 07 08:26:44 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:44 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648" returned: 0 in 0.752s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:44 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648 Jul 07 08:26:44 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:44 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.info" returned: 0 in 0.665s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:44 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.info is being set with open permissions: ugo+rw Jul 07 08:26:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:44 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.info Jul 07 08:26:44 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:45 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-80456f4d-ce63-4821-925b-cdd5d2c24648" returned: 0 in 0.686s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Lock "cinder-quobyte-80456f4d-ce63-4821-925b-cdd5d2c24648" released by "delete_volume" :: held 1.475s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=93,cinder:UPDATE=112,cinder:DELETE=5,cinder:INSERT=21 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Created reservations ['e9335c89-cdf2-4e7b-b891-ed4d2280b2b6'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:45 devstack cinder-volume[87179]: WARNING cinder.quota [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1697799364 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1697799364, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:26:45 devstack cinder-volume[87179]: WARNING cinder.quota [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1697799364 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1697799364, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Created reservations ['c856ef48-3207-4bc6-bd13-bd0b5a9d7557', '8f8492e0-0416-48fa-b415-d1cfc4479b9b', '2faaef35-d5d1-44fa-81b8-10b08a784ff4', 'bf47b4d5-e063-468d-ac71-93d97a990285'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Created reservations ['b0dc9bd2-daca-47a0-b18a-f4353c963ded', '4b3fecf0-0dc1-4cbd-8fe7-7874c03cb89f', '5c2af238-a559-47bb-ba72-288e91923a7e', '13b67ebd-ffa4-4cbd-b171-45845a52936c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:45 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.info" returned: 0 in 0.669s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.322s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-695675c4-2dd3-421c-ac8f-4ed4d58b892b tempest-VolumesSnapshotTestJSON-621817257 None] Create snapshot completed successfully Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:45 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:26:45 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:46 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.645s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:26:46 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b27fa18b-9e78-4962-af62-7c02c7a702de tempest-GroupsTest-2144582037 None] Delete group completed successfully. Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-c700e128-9d82-4bf4-b2d9-cc76912e073c-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-c700e128-9d82-4bf4-b2d9-cc76912e073c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-535f37d7-97fa-4f3e-84c7-be97fca1bef8" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-535f37d7-97fa-4f3e-84c7-be97fca1bef8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-c700e128-9d82-4bf4-b2d9-cc76912e073c" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-c700e128-9d82-4bf4-b2d9-cc76912e073c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Deleting offline snapshot c700e128-9d82-4bf4-b2d9-cc76912e073c of volume 535f37d7-97fa-4f3e-84c7-be97fca1bef8 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] snapshot_file for this snap is: volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8766bf-6367-4e2c-a09f-f41f9ac5c5e2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:46 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c Jul 07 08:26:46 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:47 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c" returned: 0 in 0.804s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:26:47 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3418ee1d-641f-4417-8f45-423868877aad]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:47 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 Jul 07 08:26:47 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:48 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8" returned: 0 in 0.808s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:48 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c Jul 07 08:26:48 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:48 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c" returned: 0 in 0.757s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:48 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c Jul 07 08:26:48 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:49 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8.c700e128-9d82-4bf4-b2d9-cc76912e073c" returned: 0 in 0.641s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-c700e128-9d82-4bf4-b2d9-cc76912e073c" released by "_delete_snapshot" :: held 3.120s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-535f37d7-97fa-4f3e-84c7-be97fca1bef8" released by "delete_snapshot" :: held 3.142s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:49 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Created reservations ['7598558d-f2ac-4dce-b6b6-1a4efd0ccbbc', '5a0c328b-f9b3-4f41-b11e-029429f05161', 'bc20795e-0425-4f14-b3e2-665ad5544c86', 'ba991d6b-b3bf-4f0b-a181-56d8e30490f5'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Delete snapshot completed successfully. Jul 07 08:26:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-813163a9-119e-4030-9f0d-4e1360d52407 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-c700e128-9d82-4bf4-b2d9-cc76912e073c-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:26:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c66d941a-8d3f-4efb-b103-15b4b5a650b3 tempest-GroupsV320Test-1423060246 None] Group tempest-GroupsV320Test-Group-1758617333: creating Jul 07 08:26:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c66d941a-8d3f-4efb-b103-15b4b5a650b3 tempest-GroupsV320Test-1423060246 None] Group tempest-GroupsV320Test-Group-1758617333: created successfully Jul 07 08:26:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c66d941a-8d3f-4efb-b103-15b4b5a650b3 tempest-GroupsV320Test-1423060246 None] Create group completed successfully. Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (4b47dde6-f0c0-4f49-a070-c2062a08e1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ab64eb-7f32-4810-9ef0-3bad829325e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ab64eb-7f32-4810-9ef0-3bad829325e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1287241865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9749a9b0-1a73-49d5-96d8-594709cf2e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28072c1ff73c4825ab384e627042658b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:51Z,use_quota=True,user_id='5e6d7ba7ee3f4218ab3692806873a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07afbde2-07a1-4f36-bf04-12179eadb292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07afbde2-07a1-4f36-bf04-12179eadb292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06def5d4-cedf-44e6-a44c-931323f6b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06def5d4-cedf-44e6-a44c-931323f6b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9749a9b0-1a73-49d5-96d8-594709cf2e14', 'volume_name': 'volume-9749a9b0-1a73-49d5-96d8-594709cf2e14', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a30122-f23e-4a01-83cc-f0c45179bec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a30122-f23e-4a01-83cc-f0c45179bec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7337c8-563d-43a6-b5c7-60721ab87b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:51 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Volume 9749a9b0-1a73-49d5-96d8-594709cf2e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9749a9b0-1a73-49d5-96d8-594709cf2e14', 'volume_size': 1} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1287241865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9749a9b0-1a73-49d5-96d8-594709cf2e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28072c1ff73c4825ab384e627042658b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:51Z,use_quota=True,user_id='5e6d7ba7ee3f4218ab3692806873a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Creating volume 9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:26:51 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:51 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 1073741824 Jul 07 08:26:51 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] Created reservations ['c4e90937-feb6-465e-ab75-605b23cdaced'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:51 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:26:51 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:52 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 1073741824" returned: 0 in 0.954s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:52 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 Jul 07 08:26:52 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:52 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:26:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a80c60b5-acf9-4445-bf03-e695374e8572 tempest-GroupsV320Test-1423060246 None] Delete group completed successfully. Jul 07 08:26:52 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14" returned: 0 in 0.660s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7337c8-563d-43a6-b5c7-60721ab87b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9749a9b0-1a73-49d5-96d8-594709cf2e14', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e95af2-1550-4897-94c9-d24811ab5f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:52 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Volume volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 (9749a9b0-1a73-49d5-96d8-594709cf2e14): created successfully Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e95af2-1550-4897-94c9-d24811ab5f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (4b47dde6-f0c0-4f49-a070-c2062a08e1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-aac2bcae-5fa3-4f50-9284-630ff5a79eae tempest-VolumesSnapshotTestJSON-621817257 None] Created volume successfully. Jul 07 08:26:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Creating offline snapshot 633becab-ad3a-4424-afa5-14cb2aa0abd3 of volume 9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:26:53 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dac7e2d-216b-49aa-bc98-bba2d1b18a8f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:53 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 Jul 07 08:26:53 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:54 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14" returned: 0 in 0.814s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:54 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 1G Jul 07 08:26:54 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:55 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 1G" returned: 0 in 0.880s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:55 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 Jul 07 08:26:55 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:55 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3" returned: 0 in 0.707s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:55 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 is being set with open permissions: ugo+rw Jul 07 08:26:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:55 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 Jul 07 08:26:55 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:56 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3" returned: 0 in 0.679s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:56 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.info Jul 07 08:26:56 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:57 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.info" returned: 0 in 0.696s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:57 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.info is being set with open permissions: ugo+rw Jul 07 08:26:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:57 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.info Jul 07 08:26:57 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:57 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.info" returned: 0 in 0.634s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.512s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f2db8453-0039-4d66-9bbe-0cf68d42c043 tempest-VolumesSnapshotTestJSON-621817257 None] Create snapshot completed successfully Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Flow 'volume_create_manager' (f9bff600-53c4-4a0b-90be-85e284a6c468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb8e4dc-9352-45ad-bc17-b017252138ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb8e4dc-9352-45ad-bc17-b017252138ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1731148693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234ce79e-095a-480d-8f4d-e8d0dfe32c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d244fa6f198b4588afd1685862409aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:58Z,use_quota=True,user_id='85418edc1b3a4a4e980e9f52fa15c6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e71f5a0-7073-4bc3-bc86-7cdb33720fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e71f5a0-7073-4bc3-bc86-7cdb33720fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2398a0a-3e75-4173-a454-5cd6d42ee3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2398a0a-3e75-4173-a454-5cd6d42ee3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234ce79e-095a-480d-8f4d-e8d0dfe32c9d', 'volume_name': 'volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4d3aed-ce24-4d35-946f-081bbcca3f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4d3aed-ce24-4d35-946f-081bbcca3f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bfd3ba-02c5-4fdd-8560-51634edb1bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:58 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Volume 234ce79e-095a-480d-8f4d-e8d0dfe32c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d', 'volume_size': 1} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1731148693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234ce79e-095a-480d-8f4d-e8d0dfe32c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d244fa6f198b4588afd1685862409aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:58Z,use_quota=True,user_id='85418edc1b3a4a4e980e9f52fa15c6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Creating volume 234ce79e-095a-480d-8f4d-e8d0dfe32c9d {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:26:58 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:58 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d 1073741824 Jul 07 08:26:58 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:58 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d 1073741824" returned: 0 in 0.856s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:59 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d Jul 07 08:26:59 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (e1b22aac-6646-4f34-af29-b7e6b0774bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b4089e-3ae4-457c-ae1b-2c3b70493923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b4089e-3ae4-457c-ae1b-2c3b70493923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1964218089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0979690e-c89d-4af9-8d66-2c7494ecafab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28072c1ff73c4825ab384e627042658b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:26:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=633becab-ad3a-4424-afa5-14cb2aa0abd3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:26:59Z,use_quota=True,user_id='5e6d7ba7ee3f4218ab3692806873a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba315722-583f-4449-90a9-093126b846a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba315722-583f-4449-90a9-093126b846a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c927163d-70e5-4a12-b663-6c1dbd9cd05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c927163d-70e5-4a12-b663-6c1dbd9cd05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0979690e-c89d-4af9-8d66-2c7494ecafab', 'volume_name': 'volume-0979690e-c89d-4af9-8d66-2c7494ecafab', 'volume_size': 2, 'snapshot_id': '633becab-ad3a-4424-afa5-14cb2aa0abd3'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff42365-2051-4650-8126-360fdf87322d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff42365-2051-4650-8126-360fdf87322d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ec7a93-692a-4c92-a15c-666d238d7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:59 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Volume 0979690e-c89d-4af9-8d66-2c7494ecafab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0979690e-c89d-4af9-8d66-2c7494ecafab', 'volume_size': 2, 'snapshot_id': '633becab-ad3a-4424-afa5-14cb2aa0abd3'} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:59 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d" returned: 0 in 0.649s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.469s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-633becab-ad3a-4424-afa5-14cb2aa0abd3-0979690e-c89d-4af9-8d66-2c7494ecafab" by "_create_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bfd3ba-02c5-4fdd-8560-51634edb1bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4790003-4416-43fc-acc5-8863413e019e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-633becab-ad3a-4424-afa5-14cb2aa0abd3-0979690e-c89d-4af9-8d66-2c7494ecafab" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Creating volume 0979690e-c89d-4af9-8d66-2c7494ecafab from snapshot 633becab-ad3a-4424-afa5-14cb2aa0abd3 {{(pid=87179) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-0979690e-c89d-4af9-8d66-2c7494ecafab" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:26:59 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Volume volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d (234ce79e-095a-480d-8f4d-e8d0dfe32c9d): created successfully Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4790003-4416-43fc-acc5-8863413e019e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Flow 'volume_create_manager' (f9bff600-53c4-4a0b-90be-85e284a6c468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-0979690e-c89d-4af9-8d66-2c7494ecafab" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] snapshot: 633becab-ad3a-4424-afa5-14cb2aa0abd3, volume: 0979690e-c89d-4af9-8d66-2c7494ecafab, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:26:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-62e11d72-5d9b-4591-9318-274a11e92853 tempest-VolumesServicesTestJSON-1318114920 None] Created volume successfully. Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db8c247-6eba-47df-9a80-a50adaa3680a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:26:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:26:59 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 Jul 07 08:26:59 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Acquiring lock "cinder-234ce79e-095a-480d-8f4d-e8d0dfe32c9d-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Lock "cinder-234ce79e-095a-480d-8f4d-e8d0dfe32c9d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Acquiring lock "cinder-quobyte-234ce79e-095a-480d-8f4d-e8d0dfe32c9d" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Lock "cinder-quobyte-234ce79e-095a-480d-8f4d-e8d0dfe32c9d" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e2b61a-7cc8-4c17-8797-6b961c900649]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:00 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d Jul 07 08:27:00 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:00 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3" returned: 0 in 0.793s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9749a9b0-1a73-49d5-96d8-594709cf2e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b287ff6-b371-488a-a317-1cc26908f02b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:00 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 Jul 07 08:27:00 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:01 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d" returned: 0 in 0.756s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:01 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d Jul 07 08:27:01 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:01 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14" returned: 0 in 0.755s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:01 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab Jul 07 08:27:01 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:01 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-234ce79e-095a-480d-8f4d-e8d0dfe32c9d" returned: 0 in 0.664s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Lock "cinder-quobyte-234ce79e-095a-480d-8f4d-e8d0dfe32c9d" released by "delete_volume" :: held 1.467s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Created reservations ['271b92ae-4293-40c1-979f-8976ca0a81b1', '5ee620ee-95e7-4978-a7a6-7c44feca2ae9', '986d39eb-3072-4196-abc9-abb5a875c897', '41769800-8c6a-428a-ab25-2b4046d4d692'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:01 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:27:01 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:03 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.115s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:03 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Deleted volume successfully. Jul 07 08:27:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1cb3ae7a-dde8-4498-82c8-05c4de7a4a3b tempest-VolumesServicesTestJSON-1318114920 None] Lock "cinder-234ce79e-095a-480d-8f4d-e8d0dfe32c9d-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:27:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:04 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:27:04 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:06 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.513s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:06 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:06 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:27:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:27:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:27:06 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab" returned: 0 in 5.247s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:06 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf734a58-88f7-45b9-98f2-707116edc189]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:06 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 Jul 07 08:27:06 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:07 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14" returned: 0 in 1.021s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:07 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:27:07 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Converted 1024.00 MB image at 195.12 MB/s Jul 07 08:27:07 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab is being set with open permissions: ugo+rw Jul 07 08:27:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:07 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab Jul 07 08:27:07 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:08 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab" returned: 0 in 0.657s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-0979690e-c89d-4af9-8d66-2c7494ecafab" released by "_copy_volume_from_snapshot" :: held 8.563s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-633becab-ad3a-4424-afa5-14cb2aa0abd3-0979690e-c89d-4af9-8d66-2c7494ecafab" released by "_create_volume_from_snapshot" :: held 8.610s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.642s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ec7a93-692a-4c92-a15c-666d238d7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0979690e-c89d-4af9-8d66-2c7494ecafab', 'volume_size': 2, 'snapshot_id': '633becab-ad3a-4424-afa5-14cb2aa0abd3'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b7983b-13c4-41f6-90b8-2100a0ebcbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:08 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Volume volume-0979690e-c89d-4af9-8d66-2c7494ecafab (0979690e-c89d-4af9-8d66-2c7494ecafab): created successfully Jul 07 08:27:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b7983b-13c4-41f6-90b8-2100a0ebcbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (e1b22aac-6646-4f34-af29-b7e6b0774bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4e8a9f3d-0ab0-43f1-99a7-d9f03d6203ee tempest-VolumesSnapshotTestJSON-621817257 None] Created volume successfully. Jul 07 08:27:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-0979690e-c89d-4af9-8d66-2c7494ecafab-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-0979690e-c89d-4af9-8d66-2c7494ecafab-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-0979690e-c89d-4af9-8d66-2c7494ecafab" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-0979690e-c89d-4af9-8d66-2c7494ecafab" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:09 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8cb63-afb9-4128-ad9a-dce27d205458]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:09 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab Jul 07 08:27:09 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:09 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab" returned: 0 in 0.797s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:10 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab Jul 07 08:27:10 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Flow 'volume_create_manager' (fc3e50fa-b264-41b0-bae4-88e1619b9836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61141cb-3217-417c-ad82-9a5a0ad7e894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61141cb-3217-417c-ad82-9a5a0ad7e894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1831286605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d2cb76-d9df-4af4-894e-e6aa9aa94f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7a74856eb442f9ad90c79e65149c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:10Z,use_quota=True,user_id='57a4f7d8934e4a5886ac861c8a24c37e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fffd81-c82b-4ffe-ba8d-7154d64b3903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fffd81-c82b-4ffe-ba8d-7154d64b3903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c215a4-f464-418b-9f90-8351b9470f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c215a4-f464-418b-9f90-8351b9470f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d2cb76-d9df-4af4-894e-e6aa9aa94f43', 'volume_name': 'volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5971e5c-ff7b-43bd-bda2-65d66d50c42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5971e5c-ff7b-43bd-bda2-65d66d50c42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664043a6-22e2-471f-b2dc-b12c366d7fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:10 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Volume 07d2cb76-d9df-4af4-894e-e6aa9aa94f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43', 'volume_size': 1} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1831286605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d2cb76-d9df-4af4-894e-e6aa9aa94f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7a74856eb442f9ad90c79e65149c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:10Z,use_quota=True,user_id='57a4f7d8934e4a5886ac861c8a24c37e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Creating volume 07d2cb76-d9df-4af4-894e-e6aa9aa94f43 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:27:10 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:10 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 1073741824 Jul 07 08:27:10 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:10 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0979690e-c89d-4af9-8d66-2c7494ecafab" returned: 0 in 0.656s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-0979690e-c89d-4af9-8d66-2c7494ecafab" released by "delete_volume" :: held 1.496s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Created reservations ['64899e87-67a7-4e8d-8535-d49e3861c808', 'f1eafea3-9134-42e1-bc93-4e236b6b9da7', '186e5b81-78dc-4038-ba1d-b11d745ee49a', 'ff945a07-3b14-471f-95fa-288e78cf3fa8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:10 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:27:10 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:11 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 1073741824" returned: 0 in 0.832s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:11 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 Jul 07 08:27:11 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-633becab-ad3a-4424-afa5-14cb2aa0abd3-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-633becab-ad3a-4424-afa5-14cb2aa0abd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-9749a9b0-1a73-49d5-96d8-594709cf2e14" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-9749a9b0-1a73-49d5-96d8-594709cf2e14" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-633becab-ad3a-4424-afa5-14cb2aa0abd3" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-633becab-ad3a-4424-afa5-14cb2aa0abd3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Deleting offline snapshot 633becab-ad3a-4424-afa5-14cb2aa0abd3 of volume 9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:27:11 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] snapshot_file for this snap is: volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.697s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:11 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Deleted volume successfully. Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3562783d-c492-4b3a-aa52-2b90454b8a03]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-85a051e4-04bf-4053-9cdf-2f8be6e5f6ed tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-0979690e-c89d-4af9-8d66-2c7494ecafab-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:11 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 Jul 07 08:27:11 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:11 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" returned: 0 in 0.724s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:27:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664043a6-22e2-471f-b2dc-b12c366d7fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d981e068-9b98-461a-9302-38c6d4e2512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:12 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Volume volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 (07d2cb76-d9df-4af4-894e-e6aa9aa94f43): created successfully Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d981e068-9b98-461a-9302-38c6d4e2512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Flow 'volume_create_manager' (fc3e50fa-b264-41b0-bae4-88e1619b9836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:12 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2539b419-acd6-4c14-a791-500247f56cef tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Created volume successfully. Jul 07 08:27:12 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3" returned: 0 in 0.758s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9749a9b0-1a73-49d5-96d8-594709cf2e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e96a0b5-7eb4-489b-94de-64e6a4e64ffd]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:12 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 Jul 07 08:27:12 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Creating offline snapshot 451d0870-2664-4992-953a-0b468d1b6d6d of volume 07d2cb76-d9df-4af4-894e-e6aa9aa94f43 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f842768f-88fd-443f-85cd-5887bad0f341]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:12 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 Jul 07 08:27:12 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:13 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14" returned: 0 in 0.802s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:13 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 Jul 07 08:27:13 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:13 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" returned: 0 in 0.761s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:13 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d 1G Jul 07 08:27:13 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:13 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3" returned: 0 in 0.787s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:13 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3 Jul 07 08:27:13 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:14 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d 1G" returned: 0 in 0.833s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:14 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d Jul 07 08:27:14 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:14 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14.633becab-ad3a-4424-afa5-14cb2aa0abd3" returned: 0 in 0.664s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-633becab-ad3a-4424-afa5-14cb2aa0abd3" released by "_delete_snapshot" :: held 3.132s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-9749a9b0-1a73-49d5-96d8-594709cf2e14" released by "delete_snapshot" :: held 3.157s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:14 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Created reservations ['7757348f-f017-4bb5-9297-54dfd136891b', '2a13c8ff-710d-4758-b03d-0ef38a83d147', '487c073a-bf97-4d7a-8b91-f87930226039', 'ecba78b6-46f2-4357-babb-eea807c1af90'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Delete snapshot completed successfully. Jul 07 08:27:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-07b9644a-1304-4e5c-8300-50ee1a0913a1 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-633becab-ad3a-4424-afa5-14cb2aa0abd3-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:14 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d" returned: 0 in 0.672s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:14 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d is being set with open permissions: ugo+rw Jul 07 08:27:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:14 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d Jul 07 08:27:14 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:15 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d" returned: 0 in 0.618s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:15 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.info Jul 07 08:27:15 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-9749a9b0-1a73-49d5-96d8-594709cf2e14-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-9749a9b0-1a73-49d5-96d8-594709cf2e14-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-9749a9b0-1a73-49d5-96d8-594709cf2e14" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-9749a9b0-1a73-49d5-96d8-594709cf2e14" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:15 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[533011c8-cf22-4ca5-9570-b9c117293297]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:15 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 Jul 07 08:27:15 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:16 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.info" returned: 0 in 0.653s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:16 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.info is being set with open permissions: ugo+rw Jul 07 08:27:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:16 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.info Jul 07 08:27:16 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:16 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14" returned: 0 in 0.762s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:16 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14 Jul 07 08:27:16 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:16 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.info" returned: 0 in 0.652s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:16 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5ffbce81-29dc-4fcc-847d-9775695ba259 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Create snapshot completed successfully Jul 07 08:27:17 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9749a9b0-1a73-49d5-96d8-594709cf2e14" returned: 0 in 0.666s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-9749a9b0-1a73-49d5-96d8-594709cf2e14" released by "delete_volume" :: held 1.484s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:17 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Created reservations ['3e777d39-e075-4baf-96b4-db41dd7f2d3f', '6decc37f-01f0-44b7-a4a6-f99b9154abef', '4fb3c76d-8c77-44bf-b862-6b0950ed3238', 'c2ff3fc5-2d3f-4aec-9681-7e8a22eac4eb'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:17 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:27:17 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:18 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.650s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:18 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Deleted volume successfully. Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-099eb0b5-fde6-4a08-95c1-1d79c199beb7 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-9749a9b0-1a73-49d5-96d8-594709cf2e14-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Acquiring lock "cinder-451d0870-2664-4992-953a-0b468d1b6d6d-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-451d0870-2664-4992-953a-0b468d1b6d6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Acquiring lock "cinder-quobyte-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-quobyte-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Acquiring lock "cinder-quobyte-451d0870-2664-4992-953a-0b468d1b6d6d" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-quobyte-451d0870-2664-4992-953a-0b468d1b6d6d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Deleting offline snapshot 451d0870-2664-4992-953a-0b468d1b6d6d of volume 07d2cb76-d9df-4af4-894e-e6aa9aa94f43 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] snapshot_file for this snap is: volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8051b23b-ad95-41fc-b56e-0dcabd3755e0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:18 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d Jul 07 08:27:18 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (6793c09b-6e0f-4723-9817-0896c36c6154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828aaaec-aade-47f3-9297-63bed481102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828aaaec-aade-47f3-9297-63bed481102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-65232395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f8edfa-4042-4055-886d-ed63468e8b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28072c1ff73c4825ab384e627042658b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:18Z,use_quota=True,user_id='5e6d7ba7ee3f4218ab3692806873a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb026a2f-a4f4-4536-8efd-7cabd3a753c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb026a2f-a4f4-4536-8efd-7cabd3a753c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9847739-35fa-4b17-a925-5e88528a26c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9847739-35fa-4b17-a925-5e88528a26c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f8edfa-4042-4055-886d-ed63468e8b7b', 'volume_name': 'volume-73f8edfa-4042-4055-886d-ed63468e8b7b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6867d33a-fde7-43d9-a6dc-cc9aa3ca3e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6867d33a-fde7-43d9-a6dc-cc9aa3ca3e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cb3048-fcb4-45f3-ae8e-8b033b2f96d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:18 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Volume 73f8edfa-4042-4055-886d-ed63468e8b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f8edfa-4042-4055-886d-ed63468e8b7b', 'volume_size': 1} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-65232395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f8edfa-4042-4055-886d-ed63468e8b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28072c1ff73c4825ab384e627042658b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:18Z,use_quota=True,user_id='5e6d7ba7ee3f4218ab3692806873a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Creating volume 73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:27:18 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:27:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:18 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b 1073741824 Jul 07 08:27:18 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:19 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d" returned: 0 in 0.779s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:27:19 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bbe03e-81fe-4c6f-bd13-b9e8adff25ad]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:19 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 Jul 07 08:27:19 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:19 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b 1073741824" returned: 0 in 0.840s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:19 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b Jul 07 08:27:19 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:19 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" returned: 0 in 0.779s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:19 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d Jul 07 08:27:19 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:20 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b" returned: 0 in 0.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cb3048-fcb4-45f3-ae8e-8b033b2f96d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f8edfa-4042-4055-886d-ed63468e8b7b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fae4e5a-4c6b-45ee-8fb5-25e860f6d885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:20 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Volume volume-73f8edfa-4042-4055-886d-ed63468e8b7b (73f8edfa-4042-4055-886d-ed63468e8b7b): created successfully Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fae4e5a-4c6b-45ee-8fb5-25e860f6d885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (6793c09b-6e0f-4723-9817-0896c36c6154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:20 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d24ae549-e85e-483d-91b3-eec1bd7e427f tempest-VolumesSnapshotTestJSON-621817257 None] Created volume successfully. Jul 07 08:27:20 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d" returned: 0 in 0.750s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:20 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d Jul 07 08:27:20 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Creating offline snapshot 3b07c280-5f0f-43b4-a7b1-342c0a94695e of volume 73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[59652ce3-c380-44f8-a8a9-710bcb74a1b0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:20 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b Jul 07 08:27:20 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:21 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43.451d0870-2664-4992-953a-0b468d1b6d6d" returned: 0 in 0.668s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:21 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-quobyte-451d0870-2664-4992-953a-0b468d1b6d6d" released by "_delete_snapshot" :: held 3.099s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:21 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-quobyte-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" released by "delete_snapshot" :: held 3.120s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:21 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Created reservations ['04037dbd-924d-43df-9c17-c89eb279c2ff', '0c2f0141-62c3-42f8-b2f4-7d1d993d3d19', '6e3b79ce-ad93-4fa4-a732-4aaca97a658a', 'f634d1a5-d824-4460-8f14-46e2c4807ed4'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Delete snapshot completed successfully. Jul 07 08:27:21 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f49c2afc-c19c-4a89-b134-058619532ca5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-451d0870-2664-4992-953a-0b468d1b6d6d-delete_snapshot" released by "delete_snapshot" :: held 3.292s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:21 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b" returned: 0 in 0.782s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:21 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e 1G Jul 07 08:27:21 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:22 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e 1G" returned: 0 in 0.829s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73f8edfa-4042-4055-886d-ed63468e8b7b -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:22 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73f8edfa-4042-4055-886d-ed63468e8b7b -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e Jul 07 08:27:22 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Acquiring lock "cinder-07d2cb76-d9df-4af4-894e-e6aa9aa94f43-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-07d2cb76-d9df-4af4-894e-e6aa9aa94f43-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Acquiring lock "cinder-quobyte-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-quobyte-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:22 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ec0bc7-55f5-439a-b6ba-d45e76dde7d7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:22 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 Jul 07 08:27:22 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:23 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73f8edfa-4042-4055-886d-ed63468e8b7b -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e" returned: 0 in 0.708s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:23 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e is being set with open permissions: ugo+rw Jul 07 08:27:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:23 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e Jul 07 08:27:23 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:23 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" returned: 0 in 0.789s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:23 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43 Jul 07 08:27:23 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:23 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e" returned: 0 in 0.617s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:23 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.info Jul 07 08:27:23 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:24 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" returned: 0 in 0.651s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-quobyte-07d2cb76-d9df-4af4-894e-e6aa9aa94f43" released by "delete_volume" :: held 1.500s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Created reservations ['ff8f0117-a4cb-4ade-862d-739036032ea0', 'ca815f99-a238-4d1c-9dad-72108ce03727', 'da2d908f-0331-476b-99f0-ce84157b3cbb', 'a63ee03e-783c-453b-9958-4201152579ef'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:24 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:27:24 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:24 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.info" returned: 0 in 0.654s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:24 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.info is being set with open permissions: ugo+rw Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:24 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.info Jul 07 08:27:24 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:24 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.656s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Deleted volume successfully. Jul 07 08:27:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a9f50f28-3b7f-4802-850a-4409ed46059e tempest-VolumeSnapshotQuotasNegativeTestJSON-1309222859 None] Lock "cinder-07d2cb76-d9df-4af4-894e-e6aa9aa94f43-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:25 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.info" returned: 0 in 0.669s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-33590e43-2a84-4475-8ffc-3c57edc510c1 tempest-VolumesSnapshotTestJSON-621817257 None] Create snapshot completed successfully Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (2f6a4128-5ab9-4852-80a0-a13ffd0e1dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faa9dff-b91f-49a5-9d60-b799fdc3c0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faa9dff-b91f-49a5-9d60-b799fdc3c0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1022646402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf109fd9-820c-4ddf-9c78-988316c066fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28072c1ff73c4825ab384e627042658b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b07c280-5f0f-43b4-a7b1-342c0a94695e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:26Z,use_quota=True,user_id='5e6d7ba7ee3f4218ab3692806873a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7e0f80-4d1a-41b2-98d4-11ba6ca119a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7e0f80-4d1a-41b2-98d4-11ba6ca119a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5113195-c57f-4f22-97ae-9b1bffd5256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5113195-c57f-4f22-97ae-9b1bffd5256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf109fd9-820c-4ddf-9c78-988316c066fb', 'volume_name': 'volume-cf109fd9-820c-4ddf-9c78-988316c066fb', 'volume_size': 1, 'snapshot_id': '3b07c280-5f0f-43b4-a7b1-342c0a94695e'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9fac7b-3a73-43e1-a5e5-3ecb6c68c58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9fac7b-3a73-43e1-a5e5-3ecb6c68c58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22332ba-a3b9-4a1b-8e6a-9735f8282f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:26 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Volume cf109fd9-820c-4ddf-9c78-988316c066fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf109fd9-820c-4ddf-9c78-988316c066fb', 'volume_size': 1, 'snapshot_id': '3b07c280-5f0f-43b4-a7b1-342c0a94695e'} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-3b07c280-5f0f-43b4-a7b1-342c0a94695e-cf109fd9-820c-4ddf-9c78-988316c066fb" by "_create_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-3b07c280-5f0f-43b4-a7b1-342c0a94695e-cf109fd9-820c-4ddf-9c78-988316c066fb" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Creating volume cf109fd9-820c-4ddf-9c78-988316c066fb from snapshot 3b07c280-5f0f-43b4-a7b1-342c0a94695e {{(pid=87179) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-cf109fd9-820c-4ddf-9c78-988316c066fb" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-cf109fd9-820c-4ddf-9c78-988316c066fb" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] snapshot: 3b07c280-5f0f-43b4-a7b1-342c0a94695e, volume: cf109fd9-820c-4ddf-9c78-988316c066fb, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f95ba1-4ca3-4377-844a-110a84aea81e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:26 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e Jul 07 08:27:26 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:27 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e" returned: 0 in 0.801s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73f8edfa-4042-4055-886d-ed63468e8b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:27:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:27:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:27:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[90974a15-9eac-4a4f-bdc4-41a37c1b2ba8]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:27 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b Jul 07 08:27:27 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:28 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b" returned: 0 in 0.794s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:28 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:27:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:28 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb Jul 07 08:27:28 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Flow 'volume_create_manager' (457158ce-e19a-472e-8406-c88da66e6602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8875ad-170d-447d-bd4b-8810e2a43d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8875ad-170d-447d-bd4b-8810e2a43d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-997648198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b942b476-71ac-445d-a17b-5eca4efde27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0487787d2bdc42ed82e6c7c2e26b8fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:32Z,use_quota=True,user_id='50e2498bb4c34386b8148d2a9ab0860d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bc8177e-2c44-4257-be4e-c16906964817),volume_type_id=3bc8177e-2c44-4257-be4e-c16906964817)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d590bfd-1fe0-4fd5-a00a-29302b179856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d590bfd-1fe0-4fd5-a00a-29302b179856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ace778c-07a9-405c-8c5f-d77cdb8cf66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ace778c-07a9-405c-8c5f-d77cdb8cf66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b942b476-71ac-445d-a17b-5eca4efde27f', 'volume_name': 'volume-b942b476-71ac-445d-a17b-5eca4efde27f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9d888b-8f29-4973-b985-59af39be89fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9d888b-8f29-4973-b985-59af39be89fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c76003-9c8a-4084-a22f-c237e7762383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:32 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Volume b942b476-71ac-445d-a17b-5eca4efde27f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b942b476-71ac-445d-a17b-5eca4efde27f', 'volume_size': 1} Jul 07 08:27:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:33 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb" returned: 0 in 4.796s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:33 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0137a7-dbcd-409b-95c3-15c070a3f521]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:33 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b Jul 07 08:27:33 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:34 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b" returned: 0 in 0.891s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:27:34 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Converted 1024.00 MB image at 213.42 MB/s Jul 07 08:27:34 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb is being set with open permissions: ugo+rw Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:34 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb Jul 07 08:27:34 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:34 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb" returned: 0 in 0.626s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-cf109fd9-820c-4ddf-9c78-988316c066fb" released by "_copy_volume_from_snapshot" :: held 8.015s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-3b07c280-5f0f-43b4-a7b1-342c0a94695e-cf109fd9-820c-4ddf-9c78-988316c066fb" released by "_create_volume_from_snapshot" :: held 8.045s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.062s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.715s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-997648198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b942b476-71ac-445d-a17b-5eca4efde27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0487787d2bdc42ed82e6c7c2e26b8fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:32Z,use_quota=True,user_id='50e2498bb4c34386b8148d2a9ab0860d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bc8177e-2c44-4257-be4e-c16906964817),volume_type_id=3bc8177e-2c44-4257-be4e-c16906964817)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Creating volume b942b476-71ac-445d-a17b-5eca4efde27f {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:27:34 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:34 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f 1073741824 Jul 07 08:27:34 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22332ba-a3b9-4a1b-8e6a-9735f8282f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf109fd9-820c-4ddf-9c78-988316c066fb', 'volume_size': 1, 'snapshot_id': '3b07c280-5f0f-43b4-a7b1-342c0a94695e'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d32ccf-1bab-40ab-b420-4f6c74eca901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:34 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Volume volume-cf109fd9-820c-4ddf-9c78-988316c066fb (cf109fd9-820c-4ddf-9c78-988316c066fb): created successfully Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d32ccf-1bab-40ab-b420-4f6c74eca901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Flow 'volume_create_manager' (2f6a4128-5ab9-4852-80a0-a13ffd0e1dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:34 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f7f9dd19-cfb3-4f71-bda5-6f27de73eb3b tempest-VolumesSnapshotTestJSON-621817257 None] Created volume successfully. Jul 07 08:27:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-cf109fd9-820c-4ddf-9c78-988316c066fb-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-cf109fd9-820c-4ddf-9c78-988316c066fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-cf109fd9-820c-4ddf-9c78-988316c066fb" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-cf109fd9-820c-4ddf-9c78-988316c066fb" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a3273e-7e5c-4d3b-aca8-3d23a1da03f3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:35 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb Jul 07 08:27:35 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:35 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f 1073741824" returned: 0 in 0.852s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:35 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f Jul 07 08:27:35 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:36 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb" returned: 0 in 0.771s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:36 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb Jul 07 08:27:36 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:36 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f" returned: 0 in 0.685s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c76003-9c8a-4084-a22f-c237e7762383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b942b476-71ac-445d-a17b-5eca4efde27f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f10a65-69f7-4963-ae25-71d00beca3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:36 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Volume volume-b942b476-71ac-445d-a17b-5eca4efde27f (b942b476-71ac-445d-a17b-5eca4efde27f): created successfully Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f10a65-69f7-4963-ae25-71d00beca3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Flow 'volume_create_manager' (457158ce-e19a-472e-8406-c88da66e6602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-104d96b9-ebbb-494e-876d-eeb7fae65e67 tempest-VolumeTypesAccessTest-1710464846 None] Created volume successfully. Jul 07 08:27:36 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cf109fd9-820c-4ddf-9c78-988316c066fb" returned: 0 in 0.647s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-cf109fd9-820c-4ddf-9c78-988316c066fb" released by "delete_volume" :: held 1.457s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=99,cinder:SELECT=105,cinder:DELETE=10,cinder:INSERT=19 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Created reservations ['f410fa70-6a22-43b9-926c-9cae09cb6f9e', '44c6c397-a11d-4750-92ea-5d3f980aa39d', '69dae9a6-eec0-4543-beb6-2ff60eaa511a', '5d2816f4-13b6-4393-94a6-e1819bbbb41d'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:36 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:27:36 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Acquiring lock "cinder-b942b476-71ac-445d-a17b-5eca4efde27f-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Lock "cinder-b942b476-71ac-445d-a17b-5eca4efde27f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Acquiring lock "cinder-quobyte-b942b476-71ac-445d-a17b-5eca4efde27f" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Lock "cinder-quobyte-b942b476-71ac-445d-a17b-5eca4efde27f" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6086d12-302f-425f-8b75-15c71481c313]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:37 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f Jul 07 08:27:37 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:37 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.653s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-3b07c280-5f0f-43b4-a7b1-342c0a94695e-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:37 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Deleted volume successfully. Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-3b07c280-5f0f-43b4-a7b1-342c0a94695e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-73f8edfa-4042-4055-886d-ed63468e8b7b" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-158500b2-d965-4e76-a487-ee3477dbd89e tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-cf109fd9-820c-4ddf-9c78-988316c066fb-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-73f8edfa-4042-4055-886d-ed63468e8b7b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-3b07c280-5f0f-43b4-a7b1-342c0a94695e" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-3b07c280-5f0f-43b4-a7b1-342c0a94695e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Deleting offline snapshot 3b07c280-5f0f-43b4-a7b1-342c0a94695e of volume 73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] snapshot_file for this snap is: volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2dc37b-9c82-45a3-8172-515ce579c113]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:37 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e Jul 07 08:27:37 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:37 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f" returned: 0 in 0.737s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:37 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f Jul 07 08:27:37 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:38 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e" returned: 0 in 0.763s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73f8edfa-4042-4055-886d-ed63468e8b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5814c3e1-dedd-4b4f-a456-dba472e85a68]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:38 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b942b476-71ac-445d-a17b-5eca4efde27f" returned: 0 in 0.631s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Lock "cinder-quobyte-b942b476-71ac-445d-a17b-5eca4efde27f" released by "delete_volume" :: held 1.405s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:38 devstack cinder-volume[87179]: WARNING cinder.quota [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-532385987 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-532385987, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:27:38 devstack cinder-volume[87179]: WARNING cinder.quota [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-532385987 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-532385987, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:27:38 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b Jul 07 08:27:38 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Created reservations ['6789a88a-406c-4019-8b86-1b2ff97c68fd', '94c80cf3-f606-4e5d-9b10-f28a62b9247e', 'd977f301-804e-4a40-8e8f-fe6197d5fd26', 'ed8ed1c1-6a04-489f-85d1-14d3d70da0b2'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:38 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:27:38 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:39 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b" returned: 0 in 0.761s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:39 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e Jul 07 08:27:39 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:39 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.646s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:39 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:39 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Deleted volume successfully. Jul 07 08:27:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3580bd17-3f10-47a7-97af-c8f0eab7e90e tempest-VolumeTypesAccessTest-1710464846 None] Lock "cinder-b942b476-71ac-445d-a17b-5eca4efde27f-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:39 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e" returned: 0 in 0.724s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:40 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e Jul 07 08:27:40 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:40 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b.3b07c280-5f0f-43b4-a7b1-342c0a94695e" returned: 0 in 0.647s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-3b07c280-5f0f-43b4-a7b1-342c0a94695e" released by "_delete_snapshot" :: held 2.992s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-73f8edfa-4042-4055-886d-ed63468e8b7b" released by "delete_snapshot" :: held 3.013s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:40 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Created reservations ['886ae894-8c2c-442a-bfeb-572fc3fef5dc', '5c5cb6bf-2e17-47ac-8803-8a7856656b25', 'c70c3aa1-a3a6-42f1-abbf-7374941a406f', 'ba2c17f4-cc27-42a3-8be1-607e697e4e57'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:40 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Delete snapshot completed successfully. Jul 07 08:27:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7e0bf81-afa7-44a8-8a75-7785c41ed57a tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-3b07c280-5f0f-43b4-a7b1-342c0a94695e-delete_snapshot" released by "delete_snapshot" :: held 3.164s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-73f8edfa-4042-4055-886d-ed63468e8b7b-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-73f8edfa-4042-4055-886d-ed63468e8b7b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-73f8edfa-4042-4055-886d-ed63468e8b7b" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-73f8edfa-4042-4055-886d-ed63468e8b7b" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:41 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a94f68-51c2-4b8b-b471-5eb9b1ac7688]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:41 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b Jul 07 08:27:41 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:41 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b" returned: 0 in 0.793s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:41 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b Jul 07 08:27:41 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:42 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-73f8edfa-4042-4055-886d-ed63468e8b7b" returned: 0 in 0.681s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-73f8edfa-4042-4055-886d-ed63468e8b7b" released by "delete_volume" :: held 1.539s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:42 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Created reservations ['b3392fe6-f429-4d7d-a0c3-48dee413f1d6', '0d3b08a2-0628-4fe4-baed-862bc4d39d38', '9b27f162-e4ac-41ab-bcfb-dfe6f1ce7e88', '9171f974-9af4-4604-a497-b3effc5556ed'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:42 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:27:42 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-535f37d7-97fa-4f3e-84c7-be97fca1bef8-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-535f37d7-97fa-4f3e-84c7-be97fca1bef8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "cinder-quobyte-535f37d7-97fa-4f3e-84c7-be97fca1bef8" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-535f37d7-97fa-4f3e-84c7-be97fca1bef8" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:43 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef82a7d-9459-44b7-977d-e02a1926b63b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:43 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.740s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:43 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Deleted volume successfully. Jul 07 08:27:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c0b6a97-f0ed-4263-9a8a-a997bb806849 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-73f8edfa-4042-4055-886d-ed63468e8b7b-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:43 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 Jul 07 08:27:43 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:44 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8" returned: 0 in 0.800s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:44 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8 Jul 07 08:27:44 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:44 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-535f37d7-97fa-4f3e-84c7-be97fca1bef8" returned: 0 in 0.675s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-quobyte-535f37d7-97fa-4f3e-84c7-be97fca1bef8" released by "delete_volume" :: held 1.547s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:44 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Created reservations ['340a64cb-f10a-4f3a-aebd-0f77de5db391', '36a6d963-4819-4c45-9477-68f2ed08713a', 'a900633f-aaf8-4e3d-808c-9835918edead', 'f96d5c5a-a431-4e23-aafb-bfd08fa3f4bb'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:27:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:45 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:27:45 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:45 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.714s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:45 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:27:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Deleted volume successfully. Jul 07 08:27:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b0e2e030-460a-41c6-b6d0-ea67765530c0 tempest-VolumesSnapshotTestJSON-621817257 None] Lock "cinder-535f37d7-97fa-4f3e-84c7-be97fca1bef8-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:27:55 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=114,cinder:INSERT=36,cinder:UPDATE=132,cinder:DELETE=8 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:27:55 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:INSERT=12,cinder:UPDATE=41,cinder:SELECT=17,cinder:DELETE=3 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Flow 'volume_create_manager' (7686887f-d8b5-4960-ba3d-ad82008fa622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a08cab3-3e4a-43c4-a07a-979e2c04185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a08cab3-3e4a-43c4-a07a-979e2c04185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1509388008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f04440-233c-4e99-8348-8880fad6a579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e07ab6ac6d40eabca49b23f9b6c95c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:56Z,use_quota=True,user_id='15e966a73e9f40f8bda3c4110acc9f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1a9430-8469-4e88-b5fb-f8c6e6663734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1a9430-8469-4e88-b5fb-f8c6e6663734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad22a698-d73d-4ac5-b6e1-93f182aba5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad22a698-d73d-4ac5-b6e1-93f182aba5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f04440-233c-4e99-8348-8880fad6a579', 'volume_name': 'volume-c5f04440-233c-4e99-8348-8880fad6a579', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b100ecd7-9dc8-4502-838f-2d8d435ef612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b100ecd7-9dc8-4502-838f-2d8d435ef612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025345bd-8c15-43b3-9cd1-c9b31693dbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:56 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Volume c5f04440-233c-4e99-8348-8880fad6a579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f04440-233c-4e99-8348-8880fad6a579', 'volume_size': 1} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1509388008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f04440-233c-4e99-8348-8880fad6a579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e07ab6ac6d40eabca49b23f9b6c95c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:27:56Z,use_quota=True,user_id='15e966a73e9f40f8bda3c4110acc9f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Creating volume c5f04440-233c-4e99-8348-8880fad6a579 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:27:56 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:27:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:56 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579 1073741824 Jul 07 08:27:56 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:57 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579 1073741824" returned: 0 in 1.011s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:57 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579 Jul 07 08:27:57 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:57 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579" returned: 0 in 0.697s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:27:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:27:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025345bd-8c15-43b3-9cd1-c9b31693dbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f04440-233c-4e99-8348-8880fad6a579', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef225b5e-903e-40f3-9ff5-3a490657d3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:27:58 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Volume volume-c5f04440-233c-4e99-8348-8880fad6a579 (c5f04440-233c-4e99-8348-8880fad6a579): created successfully Jul 07 08:27:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef225b5e-903e-40f3-9ff5-3a490657d3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:27:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Flow 'volume_create_manager' (7686887f-d8b5-4960-ba3d-ad82008fa622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:27:58 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-007b35ed-f931-4876-a060-5c7dc43bfa05 tempest-VolumesMetadataTest-2001586640 None] Created volume successfully. Jul 07 08:27:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Acquiring lock "cinder-c5f04440-233c-4e99-8348-8880fad6a579-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Lock "cinder-c5f04440-233c-4e99-8348-8880fad6a579-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Acquiring lock "cinder-quobyte-c5f04440-233c-4e99-8348-8880fad6a579" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:27:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Lock "cinder-quobyte-c5f04440-233c-4e99-8348-8880fad6a579" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:27:59 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2400417-91c6-4097-8613-cbba853fa64a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:27:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:59 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579 Jul 07 08:27:59 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:27:59 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Jul 07 08:27:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579" returned: 0 in 0.880s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:27:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:27:59 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579 Jul 07 08:27:59 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:00 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c5f04440-233c-4e99-8348-8880fad6a579" returned: 0 in 0.729s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Lock "cinder-quobyte-c5f04440-233c-4e99-8348-8880fad6a579" released by "delete_volume" :: held 1.654s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:00 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Created reservations ['bcb642ec-12d8-40a4-a22b-bef5f05eb11e', '09d74b2f-e48d-46eb-8bf9-0329d75c4fe0', '0958da4b-1cce-4db6-918e-3ecdd046e4f7', '244b7650-db0c-4ac9-9530-44bbe212ea2c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:00 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:28:00 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:01 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.777s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:01 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:01 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Deleted volume successfully. Jul 07 08:28:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-159f65b3-6b3a-476c-bc41-5ff199e170b3 tempest-VolumesMetadataTest-2001586640 None] Lock "cinder-c5f04440-233c-4e99-8348-8880fad6a579-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:28:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:04 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:28:04 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:05 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.750s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:28:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:28:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:28:05 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Flow 'volume_create_manager' (d80a9b61-0be0-42bb-8722-b2067b0e9b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff89760a-65f2-4ef1-a663-4bae20b79c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff89760a-65f2-4ef1-a663-4bae20b79c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1645864281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d08cd00830e4ae0a10ceb074b422aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:06Z,use_quota=True,user_id='ae48d2b1972c4e428f84ce66f545d7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b210a7-7e75-4f92-b60b-9d2b568f28d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b210a7-7e75-4f92-b60b-9d2b568f28d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625f9f59-93f1-49c0-9518-959fe443b5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625f9f59-93f1-49c0-9518-959fe443b5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee', 'volume_name': 'volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440c093f-395b-4bf6-bdfa-35399c3f3f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440c093f-395b-4bf6-bdfa-35399c3f3f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e72a73-d327-4443-b36a-43e3ffbc159d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:06 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Volume e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee', 'volume_size': 1} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1645864281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d08cd00830e4ae0a10ceb074b422aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:06Z,use_quota=True,user_id='ae48d2b1972c4e428f84ce66f545d7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Creating volume e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:06 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:06 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee 1073741824 Jul 07 08:28:06 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:06 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee 1073741824" returned: 0 in 0.923s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:07 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee Jul 07 08:28:07 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:07 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee" returned: 0 in 0.812s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e72a73-d327-4443-b36a-43e3ffbc159d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea22900e-aca3-4b1d-b02b-1f923d119ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:07 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Volume volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee (e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee): created successfully Jul 07 08:28:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea22900e-aca3-4b1d-b02b-1f923d119ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Flow 'volume_create_manager' (d80a9b61-0be0-42bb-8722-b2067b0e9b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7019cd67-d37c-44b8-9684-c10cb250be32 tempest-VolumesTransfersTest-488217099 None] Created volume successfully. Jul 07 08:28:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-47f7d5a9-b12d-4c56-a446-0d111ed43606 tempest-VolumesTransfersTest-2047541448 None] Transfer volume completed successfully. Jul 07 08:28:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Acquiring lock "cinder-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Lock "cinder-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Acquiring lock "cinder-quobyte-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Lock "cinder-quobyte-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:09 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2384c712-6ce5-42b1-bf3d-a6fdaf239a11]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:09 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee Jul 07 08:28:09 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:10 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee" returned: 0 in 0.818s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:10 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee Jul 07 08:28:10 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:11 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee" returned: 0 in 0.650s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Lock "cinder-quobyte-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee" released by "delete_volume" :: held 1.515s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:11 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Created reservations ['9f68b263-d713-42f8-88a1-ca7f21172a76', '05d11e66-75d5-45a6-8d43-a59981affd51', 'e6379d32-f8e8-49e3-bf80-4090a96d283d', 'a2020131-6eb2-4322-b70f-e01fc20e87b1'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:11 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:28:11 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:12 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.685s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:12 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Deleted volume successfully. Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-260251e3-1e53-4121-86df-f4b008d28074 tempest-VolumesTransfersTest-2060547902 None] Lock "cinder-e0ba6bcb-5811-4ab5-a71b-f2c74ed996ee-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Flow 'volume_create_manager' (e21bce8d-4ac5-4dad-996d-00d78a122345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b644899-efee-456e-b44a-14c074f61e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b644899-efee-456e-b44a-14c074f61e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-222950274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270278b3-ece4-4b5e-9f63-361f67b35f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d08cd00830e4ae0a10ceb074b422aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:12Z,use_quota=True,user_id='ae48d2b1972c4e428f84ce66f545d7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4333a8-3eb4-432f-a45d-ec2a3a404249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4333a8-3eb4-432f-a45d-ec2a3a404249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30888c86-cfa6-4f92-a112-3bdb6e38c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30888c86-cfa6-4f92-a112-3bdb6e38c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270278b3-ece4-4b5e-9f63-361f67b35f22', 'volume_name': 'volume-270278b3-ece4-4b5e-9f63-361f67b35f22', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3abd646-4290-42ef-9a64-4de76ae690e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3abd646-4290-42ef-9a64-4de76ae690e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4160d64-7136-49db-99de-b2248361c5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:12 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Volume 270278b3-ece4-4b5e-9f63-361f67b35f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270278b3-ece4-4b5e-9f63-361f67b35f22', 'volume_size': 1} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-222950274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270278b3-ece4-4b5e-9f63-361f67b35f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d08cd00830e4ae0a10ceb074b422aa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:12Z,use_quota=True,user_id='ae48d2b1972c4e428f84ce66f545d7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Creating volume 270278b3-ece4-4b5e-9f63-361f67b35f22 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:12 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:28:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:12 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22 1073741824 Jul 07 08:28:12 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:13 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22 1073741824" returned: 0 in 0.848s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:13 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22 Jul 07 08:28:13 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:14 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22" returned: 0 in 0.703s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4160d64-7136-49db-99de-b2248361c5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270278b3-ece4-4b5e-9f63-361f67b35f22', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25037a38-8720-4574-a109-446f5da71302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:14 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Volume volume-270278b3-ece4-4b5e-9f63-361f67b35f22 (270278b3-ece4-4b5e-9f63-361f67b35f22): created successfully Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25037a38-8720-4574-a109-446f5da71302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Flow 'volume_create_manager' (e21bce8d-4ac5-4dad-996d-00d78a122345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-043a06e7-b0d0-4488-aaa9-c44aec7ec981 tempest-VolumesTransfersTest-488217099 None] Created volume successfully. Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Acquiring lock "cinder-270278b3-ece4-4b5e-9f63-361f67b35f22-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Lock "cinder-270278b3-ece4-4b5e-9f63-361f67b35f22-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Acquiring lock "cinder-quobyte-270278b3-ece4-4b5e-9f63-361f67b35f22" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Lock "cinder-quobyte-270278b3-ece4-4b5e-9f63-361f67b35f22" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d30f338-2981-41bd-95ac-534eaacf5369]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:15 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22 Jul 07 08:28:15 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:15 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22" returned: 0 in 0.761s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:15 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22 Jul 07 08:28:15 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:16 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-270278b3-ece4-4b5e-9f63-361f67b35f22" returned: 0 in 0.657s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Lock "cinder-quobyte-270278b3-ece4-4b5e-9f63-361f67b35f22" released by "delete_volume" :: held 1.465s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:16 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Created reservations ['994a7857-99e7-4093-94bd-7dc4a70b238c', '566dc172-7aad-44ea-8ada-7f72328a8e68', 'e5bd82c6-e565-465d-9258-09d74aa4d534', '6b3d41be-bf04-4d12-b2bb-bb5dc5228a3d'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:28:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:16 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:16 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:16 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:28:16 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:17 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.630s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:17 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:28:17 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Deleted volume successfully. Jul 07 08:28:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-59c08730-ff23-42a2-98ae-8a984a4a50a3 tempest-VolumesTransfersTest-2060547902 None] Lock "cinder-270278b3-ece4-4b5e-9f63-361f67b35f22-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:26 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=21,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=5 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:28:27 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=22,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Flow 'volume_create_manager' (85a318b0-e6de-4e1e-9410-0c3373fd0fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d0aaf6-550f-41da-872d-196fef2ce553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d0aaf6-550f-41da-872d-196fef2ce553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-420912945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6277db4-86e9-4fe7-bbd8-5dc3293080aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1e52025540434ea3f696721488ab7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:31Z,use_quota=True,user_id='dde5470dc9e84452b025f0610e6fb52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b349e8-4a41-4120-b846-eefcbc4aebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b349e8-4a41-4120-b846-eefcbc4aebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8001de22-2530-46ba-8ed6-8cf30928dbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8001de22-2530-46ba-8ed6-8cf30928dbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6277db4-86e9-4fe7-bbd8-5dc3293080aa', 'volume_name': 'volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7636fcdd-e0de-460d-9812-84dda90a12f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7636fcdd-e0de-460d-9812-84dda90a12f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6e9512-ce05-4ed8-ba3b-b113a29c7bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Volume a6277db4-86e9-4fe7-bbd8-5dc3293080aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa', 'volume_size': 1} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-420912945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6277db4-86e9-4fe7-bbd8-5dc3293080aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1e52025540434ea3f696721488ab7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:31Z,use_quota=True,user_id='dde5470dc9e84452b025f0610e6fb52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Creating volume a6277db4-86e9-4fe7-bbd8-5dc3293080aa {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:31 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:28:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:31 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa 1073741824 Jul 07 08:28:31 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:32 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa 1073741824" returned: 0 in 1.048s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:32 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa Jul 07 08:28:32 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:32 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:28:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Flow 'volume_create_manager' (86113055-1ec5-4ffd-9728-49f9b8ecd63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc235fa-7382-420f-87bb-1bf47acc0c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc235fa-7382-420f-87bb-1bf47acc0c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1937666057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11dd5b42-a2d9-43b4-93b6-7d067f1045b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e98a6d409554f46a3210a9b39bb6175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:33Z,use_quota=True,user_id='4a3f403c1cce4d9aa11032e2e40c8897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94a54ef-2bfb-4085-996d-1248c823b90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94a54ef-2bfb-4085-996d-1248c823b90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d860d09-a4d1-428d-91ec-fcf2577afba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d860d09-a4d1-428d-91ec-fcf2577afba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11dd5b42-a2d9-43b4-93b6-7d067f1045b8', 'volume_name': 'volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ccf8e02-98ad-4a78-b035-985e4ab223b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ccf8e02-98ad-4a78-b035-985e4ab223b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac5775b-ce65-4802-bb05-e01d732c45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Volume 11dd5b42-a2d9-43b4-93b6-7d067f1045b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8', 'volume_size': 1} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:33 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa" returned: 0 in 0.669s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.312s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1937666057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11dd5b42-a2d9-43b4-93b6-7d067f1045b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e98a6d409554f46a3210a9b39bb6175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:28:33Z,use_quota=True,user_id='4a3f403c1cce4d9aa11032e2e40c8897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Creating volume 11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:28:33 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:33 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 1073741824 Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6e9512-ce05-4ed8-ba3b-b113a29c7bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:33 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c027ae74-ebde-4ef1-bf4a-9ed3079145bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Volume volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa (a6277db4-86e9-4fe7-bbd8-5dc3293080aa): created successfully Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c027ae74-ebde-4ef1-bf4a-9ed3079145bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Flow 'volume_create_manager' (85a318b0-e6de-4e1e-9410-0c3373fd0fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-36775a76-f402-4cbe-9da6-d7ecf4bec618 tempest-TestMinimumBasicScenario-699151585 None] Created volume successfully. Jul 07 08:28:34 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 1073741824" returned: 0 in 0.806s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:34 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 Jul 07 08:28:34 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:34 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" returned: 0 in 0.656s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:28:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac5775b-ce65-4802-bb05-e01d732c45f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc696f6e-13be-4142-8f04-2e760e1eea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:28:34 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Volume volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 (11dd5b42-a2d9-43b4-93b6-7d067f1045b8): created successfully Jul 07 08:28:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc696f6e-13be-4142-8f04-2e760e1eea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:28:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Flow 'volume_create_manager' (86113055-1ec5-4ffd-9728-49f9b8ecd63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:28:34 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2201c431-8ec1-4cf9-956e-355e062441cb tempest-VolumesActionsTest-1765378972 None] Created volume successfully. Jul 07 08:28:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-ce54192f-6ff1-4593-9fa8-32ee96e7661e req-95d30dba-8f63-48d3-b917-119bd991160f tempest-TestMinimumBasicScenario-699151585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:28:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-ce54192f-6ff1-4593-9fa8-32ee96e7661e req-95d30dba-8f63-48d3-b917-119bd991160f tempest-TestMinimumBasicScenario-699151585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:28:38 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[69059bc7-0aa2-44c5-8be3-a2548019806b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:28:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-ce54192f-6ff1-4593-9fa8-32ee96e7661e req-95d30dba-8f63-48d3-b917-119bd991160f tempest-TestMinimumBasicScenario-699151585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:28:38 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa Jul 07 08:28:38 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:28:38 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 07 08:28:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-ce54192f-6ff1-4593-9fa8-32ee96e7661e req-95d30dba-8f63-48d3-b917-119bd991160f tempest-TestMinimumBasicScenario-699151585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa" returned: 0 in 0.789s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:28:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-ce54192f-6ff1-4593-9fa8-32ee96e7661e req-95d30dba-8f63-48d3-b917-119bd991160f tempest-TestMinimumBasicScenario-699151585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:28:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-ce54192f-6ff1-4593-9fa8-32ee96e7661e req-95d30dba-8f63-48d3-b917-119bd991160f tempest-TestMinimumBasicScenario-699151585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dddf3b19-9b97-41b4-9c8b-7ad04320be4a', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:28:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-ce54192f-6ff1-4593-9fa8-32ee96e7661e req-95d30dba-8f63-48d3-b917-119bd991160f tempest-TestMinimumBasicScenario-699151585 None] attachment_update completed successfully. Jul 07 08:28:48 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:28:48 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=8,cinder:SELECT=9,cinder:DELETE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:28:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4950356a-43f3-49cb-b8f4-9f10d850fa4c tempest-VolumesActionsTest-1765378972 None] Acquiring lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" by "attach_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4950356a-43f3-49cb-b8f4-9f10d850fa4c tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" acquired by "attach_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4950356a-43f3-49cb-b8f4-9f10d850fa4c tempest-VolumesActionsTest-1765378972 None] Attaching volume 11dd5b42-a2d9-43b4-93b6-7d067f1045b8 to instance eaccc0fd-5ff5-4327-85ee-44383b546e52 at mountpoint /dev/vdb on host None. Jul 07 08:28:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4950356a-43f3-49cb-b8f4-9f10d850fa4c tempest-VolumesActionsTest-1765378972 None] Attach volume completed successfully. Jul 07 08:28:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4950356a-43f3-49cb-b8f4-9f10d850fa4c tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" released by "attach_volume" :: held 0.088s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:28:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-ec00a6f2-4523-4b99-8222-17bc2c22fef9 tempest-VolumesActionsTest-1765378972 None] Acquiring lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8-detach_volume" by "detach_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:28:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-ec00a6f2-4523-4b99-8222-17bc2c22fef9 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:28:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ec00a6f2-4523-4b99-8222-17bc2c22fef9 tempest-VolumesActionsTest-1765378972 None] Detaching volume 11dd5b42-a2d9-43b4-93b6-7d067f1045b8 from instance eaccc0fd-5ff5-4327-85ee-44383b546e52. Jul 07 08:28:53 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ec00a6f2-4523-4b99-8222-17bc2c22fef9 tempest-VolumesActionsTest-1765378972 None] Detach volume completed successfully. Jul 07 08:28:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-ec00a6f2-4523-4b99-8222-17bc2c22fef9 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:29:02 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=4 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:29:03 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:29:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:29:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:04 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:29:04 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:05 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.651s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:29:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:29:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:29:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:29:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0fe033b9-e65d-4642-8345-c39d497f0481 tempest-VolumesActionsTest-1765378972 None] Acquiring lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" by "attach_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:29:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0fe033b9-e65d-4642-8345-c39d497f0481 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" acquired by "attach_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:29:16 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-0fe033b9-e65d-4642-8345-c39d497f0481 tempest-VolumesActionsTest-1765378972 None] Attaching volume 11dd5b42-a2d9-43b4-93b6-7d067f1045b8 to instance f9aa76d1-ed09-4a17-a4d2-5070cf2ecfc0 at mountpoint /dev/vdb on host None. Jul 07 08:29:16 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-0fe033b9-e65d-4642-8345-c39d497f0481 tempest-VolumesActionsTest-1765378972 None] Attach volume completed successfully. Jul 07 08:29:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0fe033b9-e65d-4642-8345-c39d497f0481 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" released by "attach_volume" :: held 0.114s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:29:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-cfb02642-df8d-4c60-875b-5d8e1338da82 tempest-VolumesActionsTest-1765378972 None] Acquiring lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8-detach_volume" by "detach_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:29:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-cfb02642-df8d-4c60-875b-5d8e1338da82 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:29:17 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-cfb02642-df8d-4c60-875b-5d8e1338da82 tempest-VolumesActionsTest-1765378972 None] Detaching volume 11dd5b42-a2d9-43b4-93b6-7d067f1045b8 from instance f9aa76d1-ed09-4a17-a4d2-5070cf2ecfc0. Jul 07 08:29:17 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-cfb02642-df8d-4c60-875b-5d8e1338da82 tempest-VolumesActionsTest-1765378972 None] Detach volume completed successfully. Jul 07 08:29:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-cfb02642-df8d-4c60-875b-5d8e1338da82 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:29:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-b2888328-6bee-4c8d-bad7-2f9c522390e1 req-8045c853-d5d6-4191-ae1c-c1a00abe2933 tempest-TestMinimumBasicScenario-699151585 None] Terminate volume connection completed successfully. Jul 07 08:29:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-b2888328-6bee-4c8d-bad7-2f9c522390e1 req-8045c853-d5d6-4191-ae1c-c1a00abe2933 tempest-TestMinimumBasicScenario-699151585 None] Deleting attachment dddf3b19-9b97-41b4-9c8b-7ad04320be4a. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:29:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Acquiring lock "cinder-a6277db4-86e9-4fe7-bbd8-5dc3293080aa-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:29:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Lock "cinder-a6277db4-86e9-4fe7-bbd8-5dc3293080aa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:29:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Acquiring lock "cinder-quobyte-a6277db4-86e9-4fe7-bbd8-5dc3293080aa" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:29:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Lock "cinder-quobyte-a6277db4-86e9-4fe7-bbd8-5dc3293080aa" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:29:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ade3cac-3860-48f4-a39c-a48ed4fe345c]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:24 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa Jul 07 08:29:24 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:25 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa" returned: 0 in 0.863s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:25 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa Jul 07 08:29:25 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:25 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fb9a85-44e4-476f-881d-b74fcef91ca3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:25 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 Jul 07 08:29:25 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:26 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a6277db4-86e9-4fe7-bbd8-5dc3293080aa" returned: 0 in 0.688s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Lock "cinder-quobyte-a6277db4-86e9-4fe7-bbd8-5dc3293080aa" released by "delete_volume" :: held 1.598s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Created reservations ['2a3efe31-5ecd-40d1-97ef-db9a194ab0c3', 'fdfa95f4-1470-4d6f-a909-4fd10dd0e2a7', '91011d24-8293-4ec4-9d12-918b7ae9d8b7', 'd8752052-1210-46d1-85e9-b24f53868147'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:26 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:29:26 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:26 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" returned: 0 in 0.826s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4c6f59-000f-4379-86f1-389a41dbbeb5]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:26 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 Jul 07 08:29:26 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:27 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.696s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:27 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:29:27 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Deleted volume successfully. Jul 07 08:29:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-60d41a1c-07bc-4997-bdca-4f7fea5c0d57 tempest-TestMinimumBasicScenario-699151585 None] Lock "cinder-a6277db4-86e9-4fe7-bbd8-5dc3293080aa-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:29:27 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" returned: 0 in 0.840s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.82b67baf-43f4-4af6-a855-759e17979b98p9krpsye.img {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:27 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.82b67baf-43f4-4af6-a855-759e17979b98p9krpsye.img Jul 07 08:29:27 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:32 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.82b67baf-43f4-4af6-a855-759e17979b98p9krpsye.img" returned: 0 in 5.057s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:32 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[449603c9-5cee-44fc-978b-706b92b41863]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:32 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 Jul 07 08:29:32 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:33 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" returned: 0 in 0.935s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:33 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.82b67baf-43f4-4af6-a855-759e17979b98p9krpsye.img {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:29:33 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Converted 1024.00 MB image at 202.46 MB/s Jul 07 08:29:33 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] 82b67baf-43f4-4af6-a855-759e17979b98 was raw, no need to convert to raw {{(pid=87179) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 08:29:37 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:29:43 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:29:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.270s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:29:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Uploaded volume to glance image-id: 82b67baf-43f4-4af6-a855-759e17979b98. {{(pid=87179) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 08:29:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f94b17fa-155b-4a62-968b-1f7a1fb581b3 tempest-VolumesActionsTest-1765378972 None] Copy volume to image completed successfully. Jul 07 08:29:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:29:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:29:57 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[383aab9a-848d-46e1-bb6f-97bb8ff13b3f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:57 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 Jul 07 08:29:57 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:58 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" returned: 0 in 0.889s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:58 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d474db07-b54b-4c51-a157-506826479517]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:29:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:58 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 Jul 07 08:29:58 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:29:59 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Jul 07 08:29:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" returned: 0 in 0.777s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:29:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:29:59 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img Jul 07 08:29:59 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:04 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img" returned: 0 in 4.972s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4512c2e-9c72-42b0-9ae4-b11ef9fe111c]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:04 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 Jul 07 08:30:04 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:04 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:30:04 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:30:05 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" returned: 0 in 1.077s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:30:05 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Converted 1024.00 MB image at 205.87 MB/s Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] 12461f1a-4aa7-475a-831d-652a425e60e7 was raw, converting to qcow2 {{(pid=87179) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f6b73-8544-4fee-ab5e-7accb8bdfb46]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:05 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img Jul 07 08:30:05 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:05 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.784s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:30:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:30:06 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img" returned: 0 in 0.816s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:06 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img Jul 07 08:30:06 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:06 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img" returned: 1 in 0.807s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:30:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img /opt/stack/data/cinder/conversion/vol_upload_pzy8678t {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:06 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img /opt/stack/data/cinder/conversion/vol_upload_pzy8678t Jul 07 08:30:06 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:07 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img /opt/stack/data/cinder/conversion/vol_upload_pzy8678t" returned: 0 in 0.721s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:07 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Image conversion details: src /opt/stack/data/cinder/conversion/11dd5b42-a2d9-43b4-93b6-7d067f1045b8.temp_image.12461f1a-4aa7-475a-831d-652a425e60e7hob_ogul.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pzy8678t {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:30:07 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 08:30:07 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b336f7ca-197c-4f04-b92c-17a69638122a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pzy8678t {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:07 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pzy8678t Jul 07 08:30:07 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:08 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pzy8678t" returned: 0 in 0.782s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.615s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Uploaded volume to glance image-id: 12461f1a-4aa7-475a-831d-652a425e60e7. {{(pid=87179) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 08:30:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-379eba86-a1c3-4293-a625-d87fe10d7bae tempest-VolumesActionsTest-1765378972 None] Copy volume to image completed successfully. Jul 07 08:30:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Acquiring lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Acquiring lock "cinder-quobyte-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-quobyte-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:11 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b29ffd-4738-4f65-8aad-08576b5486ee]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:11 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 Jul 07 08:30:11 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:11 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" returned: 0 in 0.791s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:11 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8 Jul 07 08:30:11 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:12 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" returned: 0 in 0.717s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-quobyte-11dd5b42-a2d9-43b4-93b6-7d067f1045b8" released by "delete_volume" :: held 1.547s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:12 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Created reservations ['cae5fcef-0edc-4047-87cc-5752ac078f51', 'b6fdee54-2a6d-4c9a-895a-79f5296ca9cb', 'f18d9f82-f153-4133-9d5a-8a6cef5250ca', '414f04a5-6d5d-42b9-98db-84fa88de3ba4'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:12 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:30:12 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:13 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.677s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:13 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Deleted volume successfully. Jul 07 08:30:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-582d983d-fdb5-48c0-90a7-b4270dc6ccc7 tempest-VolumesActionsTest-1765378972 None] Lock "cinder-11dd5b42-a2d9-43b4-93b6-7d067f1045b8-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (1edaf65f-cfc3-48c0-9496-e40d419628fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ffedc8c-a015-421e-931b-b6ab4ea8fed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ffedc8c-a015-421e-931b-b6ab4ea8fed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-529603901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b647bdd8-8073-46c5-9e78-f0dbce7a0293,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:19Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5aa32b-6d8b-406e-8adb-d8f5673806e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5aa32b-6d8b-406e-8adb-d8f5673806e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7775ce1c-b6db-49fe-b73c-09a972d270ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7775ce1c-b6db-49fe-b73c-09a972d270ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b647bdd8-8073-46c5-9e78-f0dbce7a0293', 'volume_name': 'volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b97fa4-ecb4-4ffe-865a-e736a9e9b73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b97fa4-ecb4-4ffe-865a-e736a9e9b73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0361b044-303f-4868-a6e8-3ff7a462f273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:19 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Volume b647bdd8-8073-46c5-9e78-f0dbce7a0293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293', 'volume_size': 1} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-529603901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b647bdd8-8073-46c5-9e78-f0dbce7a0293,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:19Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Creating volume b647bdd8-8073-46c5-9e78-f0dbce7a0293 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:30:19 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:30:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:19 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 1073741824 Jul 07 08:30:19 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:20 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 1073741824" returned: 0 in 0.922s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:20 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 Jul 07 08:30:20 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:21 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293" returned: 0 in 0.699s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:30:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0361b044-303f-4868-a6e8-3ff7a462f273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfa974f-3f25-44ea-9716-56aa8f33dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:21 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Volume volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 (b647bdd8-8073-46c5-9e78-f0dbce7a0293): created successfully Jul 07 08:30:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfa974f-3f25-44ea-9716-56aa8f33dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (1edaf65f-cfc3-48c0-9496-e40d419628fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-113c9c3b-0ca8-4f27-a8f8-fc0a2c0074ae tempest-VolumesGetTest-2076882506 None] Created volume successfully. Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (842e5a1e-b0cd-4f99-a8e7-6045c7fff154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e1a446-4370-42ef-98f0-409f56bda1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e1a446-4370-42ef-98f0-409f56bda1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1041025291',display_name='tempest-VolumesGetTest-Volume-1818132672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11a284a-ba02-4c2b-8673-56a03d740ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:22Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a6051-c86f-40a1-834e-1daa7deabe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a6051-c86f-40a1-834e-1daa7deabe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3722c150-1cab-4d57-97d7-159898e3ea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3722c150-1cab-4d57-97d7-159898e3ea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11a284a-ba02-4c2b-8673-56a03d740ea7', 'volume_name': 'volume-c11a284a-ba02-4c2b-8673-56a03d740ea7', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3bec5c-9c36-4b8f-ac40-91c0a5c382c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3bec5c-9c36-4b8f-ac40-91c0a5c382c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2d2a06-b279-4425-a196-0ec8ed7c39b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:22 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Volume c11a284a-ba02-4c2b-8673-56a03d740ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11a284a-ba02-4c2b-8673-56a03d740ea7', 'volume_size': 1} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1041025291',display_name='tempest-VolumesGetTest-Volume-1818132672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11a284a-ba02-4c2b-8673-56a03d740ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:22Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Creating volume c11a284a-ba02-4c2b-8673-56a03d740ea7 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:30:22 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:30:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:22 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 1073741824 Jul 07 08:30:22 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:23 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 1073741824" returned: 0 in 0.830s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:23 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 Jul 07 08:30:23 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:24 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7" returned: 0 in 0.873s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2d2a06-b279-4425-a196-0ec8ed7c39b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11a284a-ba02-4c2b-8673-56a03d740ea7', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e08afb9-2ac6-4f48-8731-1a6ee9a05c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:24 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Volume volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 (c11a284a-ba02-4c2b-8673-56a03d740ea7): created successfully Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e08afb9-2ac6-4f48-8731-1a6ee9a05c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (842e5a1e-b0cd-4f99-a8e7-6045c7fff154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8a56e6c9-1a5e-4554-8972-f5912ba52bac tempest-VolumesGetTest-2076882506 None] Created volume successfully. Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-c11a284a-ba02-4c2b-8673-56a03d740ea7-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Lock "cinder-c11a284a-ba02-4c2b-8673-56a03d740ea7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-quobyte-c11a284a-ba02-4c2b-8673-56a03d740ea7" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-c11a284a-ba02-4c2b-8673-56a03d740ea7" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[99983202-9f2c-4ed1-bce5-6677367b942f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:24 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 Jul 07 08:30:24 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:25 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7" returned: 0 in 0.826s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:25 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7 Jul 07 08:30:25 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:26 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-c11a284a-ba02-4c2b-8673-56a03d740ea7" returned: 0 in 0.700s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-c11a284a-ba02-4c2b-8673-56a03d740ea7" released by "delete_volume" :: held 1.574s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Created reservations ['c6672d47-07c2-4d7a-8d98-6a95b6396908', '77b65ab9-7fed-4490-aadb-f95c9d74a28d', '85f24d98-9a3d-43c7-acb3-410262061699', '46614330-b6a3-408f-b3ad-ae746acda5e3'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:26 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:30:26 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-b647bdd8-8073-46c5-9e78-f0dbce7a0293-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Lock "cinder-b647bdd8-8073-46c5-9e78-f0dbce7a0293-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-quobyte-b647bdd8-8073-46c5-9e78-f0dbce7a0293" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-b647bdd8-8073-46c5-9e78-f0dbce7a0293" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ab4e1e-782f-40a1-a9bb-86ac8d7be2cb]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:27 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 Jul 07 08:30:27 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:27 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.866s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:27 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:27 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Deleted volume successfully. Jul 07 08:30:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d3559375-f0ed-49ca-b9ab-67b5cd24c92e tempest-VolumesGetTest-2076882506 None] Lock "cinder-c11a284a-ba02-4c2b-8673-56a03d740ea7-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:28 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293" returned: 0 in 0.938s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:28 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293 Jul 07 08:30:28 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:28 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b647bdd8-8073-46c5-9e78-f0dbce7a0293" returned: 0 in 0.735s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-b647bdd8-8073-46c5-9e78-f0dbce7a0293" released by "delete_volume" :: held 1.761s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Created reservations ['7d1bb6e7-e759-4597-8e7b-d5c13dffc32f', 'cf54f0fe-a015-4021-a8f0-7a0ca6c8dac3', 'af51dbeb-e3a7-4737-a728-502c858c08ae', '54f95849-019c-4e1c-9fd1-150853998ce0'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:28 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:30:28 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:29 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.776s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Deleted volume successfully. Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-81556fb7-8fc0-4a36-a059-50e4319addd8 tempest-VolumesGetTest-2076882506 None] Lock "cinder-b647bdd8-8073-46c5-9e78-f0dbce7a0293-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (d011afad-04e4-4503-93a4-282304360922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e23c50-c9cd-4ee2-860e-89c1989058cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e23c50-c9cd-4ee2-860e-89c1989058cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-567031564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee7e523-00aa-4629-ac58-bd98de2960eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:30Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81cebf6-1088-4a19-af94-79d1ca810e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81cebf6-1088-4a19-af94-79d1ca810e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868c86b3-7f72-4676-97ca-e1ed888e5969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868c86b3-7f72-4676-97ca-e1ed888e5969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee7e523-00aa-4629-ac58-bd98de2960eb', 'volume_name': 'volume-cee7e523-00aa-4629-ac58-bd98de2960eb', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09203a1-c989-401b-bb50-56b936b6cea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09203a1-c989-401b-bb50-56b936b6cea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9789d77-1fbd-447b-9674-d69d6db8e7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:29 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Volume cee7e523-00aa-4629-ac58-bd98de2960eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee7e523-00aa-4629-ac58-bd98de2960eb', 'volume_size': 1} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-567031564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee7e523-00aa-4629-ac58-bd98de2960eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:30Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Creating volume cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:30:29 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:30:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:29 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb 1073741824 Jul 07 08:30:29 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:30 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb 1073741824" returned: 0 in 0.869s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:30 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb Jul 07 08:30:30 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:31 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb" returned: 0 in 0.658s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:30:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9789d77-1fbd-447b-9674-d69d6db8e7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee7e523-00aa-4629-ac58-bd98de2960eb', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eae8d1a-af6a-469e-9f54-74aaa168dccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Volume volume-cee7e523-00aa-4629-ac58-bd98de2960eb (cee7e523-00aa-4629-ac58-bd98de2960eb): created successfully Jul 07 08:30:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eae8d1a-af6a-469e-9f54-74aaa168dccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (d011afad-04e4-4503-93a4-282304360922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1657bba5-e390-431c-a73d-475fa975b8e0 tempest-VolumesGetTest-2076882506 None] Created volume successfully. Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (3867dd5f-8041-4774-8821-40737ce27b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed371053-1f28-4dfc-8445-88e4d24cac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed371053-1f28-4dfc-8445-88e4d24cac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2025774465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf042a39-e0e7-4295-9c63-ba97884afa3c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cee7e523-00aa-4629-ac58-bd98de2960eb,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:33Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5ac071-8cac-4e81-aff5-328435683a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5ac071-8cac-4e81-aff5-328435683a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd8c143-0fd0-42e4-952c-b646ec656477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd8c143-0fd0-42e4-952c-b646ec656477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bf042a39-e0e7-4295-9c63-ba97884afa3c', 'volume_name': 'volume-bf042a39-e0e7-4295-9c63-ba97884afa3c', 'volume_size': 1, 'source_volid': 'cee7e523-00aa-4629-ac58-bd98de2960eb', 'source_volstatus': 'available'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed27588-7b71-455c-9fc7-3863b9dd9355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed27588-7b71-455c-9fc7-3863b9dd9355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425479bb-fb86-4b78-8e93-76225bb9993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:32 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Volume bf042a39-e0e7-4295-9c63-ba97884afa3c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bf042a39-e0e7-4295-9c63-ba97884afa3c', 'volume_size': 1, 'source_volid': 'cee7e523-00aa-4629-ac58-bd98de2960eb', 'source_volstatus': 'available'} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:32 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Cloning volume cee7e523-00aa-4629-ac58-bd98de2960eb to volume bf042a39-e0e7-4295-9c63-ba97884afa3c Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Creating offline snapshot 729bccb2-31a5-46c5-9f42-618ea1495f71 of volume cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[075bc656-0274-4f55-8e95-d1da39efbc05]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:32 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb Jul 07 08:30:32 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:33 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb" returned: 0 in 0.875s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:33 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 1G Jul 07 08:30:33 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:34 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 1G" returned: 0 in 0.855s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee7e523-00aa-4629-ac58-bd98de2960eb -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:34 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee7e523-00aa-4629-ac58-bd98de2960eb -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 Jul 07 08:30:34 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:35 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee7e523-00aa-4629-ac58-bd98de2960eb -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71" returned: 0 in 0.724s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:35 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 is being set with open permissions: ugo+rw Jul 07 08:30:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:35 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 Jul 07 08:30:35 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:35 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71" returned: 0 in 0.679s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:35 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.info Jul 07 08:30:35 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:36 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.info" returned: 0 in 0.630s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:36 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.info is being set with open permissions: ugo+rw Jul 07 08:30:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:36 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.info Jul 07 08:30:36 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:37 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.info" returned: 0 in 0.615s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-quobyte-bf042a39-e0e7-4295-9c63-ba97884afa3c" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-bf042a39-e0e7-4295-9c63-ba97884afa3c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] snapshot: 729bccb2-31a5-46c5-9f42-618ea1495f71, volume: bf042a39-e0e7-4295-9c63-ba97884afa3c, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffbed9d-86c0-49db-b378-32c30efc20c3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:37 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 Jul 07 08:30:37 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:37 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71" returned: 0 in 0.748s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cee7e523-00aa-4629-ac58-bd98de2960eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:30:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:30:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:30:38 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1342daee-b9f9-48e3-94a2-616bc5ffed3e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:38 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb Jul 07 08:30:38 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:38 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb" returned: 0 in 0.723s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:38 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:30:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:38 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c Jul 07 08:30:38 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:43 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c" returned: 0 in 4.370s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:43 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc6d3f-f332-4cb4-b6cf-34c3f901cef7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:43 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb Jul 07 08:30:43 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:44 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb" returned: 0 in 0.923s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb, size 1024.00 MB, duration 4.37 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:30:44 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Converted 1024.00 MB image at 234.26 MB/s Jul 07 08:30:44 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c is being set with open permissions: ugo+rw Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:44 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c Jul 07 08:30:44 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:44 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c" returned: 0 in 0.617s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-bf042a39-e0e7-4295-9c63-ba97884afa3c" released by "_copy_volume_from_snapshot" :: held 7.453s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-quobyte-729bccb2-31a5-46c5-9f42-618ea1495f71" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-729bccb2-31a5-46c5-9f42-618ea1495f71" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Deleting offline snapshot 729bccb2-31a5-46c5-9f42-618ea1495f71 of volume cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] snapshot_file for this snap is: volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9affc25-bf65-4151-852d-b78314623416]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:44 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 Jul 07 08:30:44 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:45 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71" returned: 0 in 0.751s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cee7e523-00aa-4629-ac58-bd98de2960eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:30:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f6f06e-1a3a-4c5b-8fd2-9ceb1a1fcd6d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:45 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb Jul 07 08:30:45 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:45 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=25,cinder:INSERT=11,cinder:UPDATE=34,cinder:DELETE=4 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:30:46 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb" returned: 0 in 0.740s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:46 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 Jul 07 08:30:46 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:46 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71" returned: 0 in 0.729s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:47 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71 Jul 07 08:30:47 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:47 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb.729bccb2-31a5-46c5-9f42-618ea1495f71" returned: 0 in 0.654s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-729bccb2-31a5-46c5-9f42-618ea1495f71" released by "_delete_snapshot" :: held 2.977s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.988s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425479bb-fb86-4b78-8e93-76225bb9993a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf042a39-e0e7-4295-9c63-ba97884afa3c', 'volume_size': 1, 'source_volid': 'cee7e523-00aa-4629-ac58-bd98de2960eb', 'source_volstatus': 'available'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4965bd2-ff0c-4982-91f1-09835ec46e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:47 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Volume volume-bf042a39-e0e7-4295-9c63-ba97884afa3c (bf042a39-e0e7-4295-9c63-ba97884afa3c): created successfully Jul 07 08:30:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4965bd2-ff0c-4982-91f1-09835ec46e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (3867dd5f-8041-4774-8821-40737ce27b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-35948986-08c5-4c85-9011-5a98de3d72f4 tempest-VolumesGetTest-2076882506 None] Created volume successfully. Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (821b003b-c754-41c1-b784-7f66c42aeeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e773b16-132d-47ae-a4ef-2ebbe473ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e773b16-132d-47ae-a4ef-2ebbe473ad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-22434116',display_name='tempest-VolumesGetTest-Volume-1448153144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e79a0ab-8922-46d1-ae52-5a07bfc4160d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:49Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c61e26c-b7e7-4449-aa8a-107bb980b54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c61e26c-b7e7-4449-aa8a-107bb980b54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddf8ff0-8af5-4eb3-8161-5ae2a769823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddf8ff0-8af5-4eb3-8161-5ae2a769823d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e79a0ab-8922-46d1-ae52-5a07bfc4160d', 'volume_name': 'volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef514c-8a28-4cf6-994a-e96856efc720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef514c-8a28-4cf6-994a-e96856efc720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d29b55-083c-4968-be7f-df6e344efd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:49 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Volume 9e79a0ab-8922-46d1-ae52-5a07bfc4160d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d', 'volume_size': 1} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-22434116',display_name='tempest-VolumesGetTest-Volume-1448153144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e79a0ab-8922-46d1-ae52-5a07bfc4160d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:49Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Creating volume 9e79a0ab-8922-46d1-ae52-5a07bfc4160d {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:30:49 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:30:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:49 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d 1073741824 Jul 07 08:30:49 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Flow 'volume_create_manager' (e1765eb7-0217-4814-a0e8-574501456803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1e9d95-7ffa-4cf3-8a33-3d3cec0155be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1e9d95-7ffa-4cf3-8a33-3d3cec0155be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1206080525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddff28a-94b1-4c55-98b4-78f50bb144aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8445eb3ba244275a837f2e72b267df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:50Z,use_quota=True,user_id='fe385d128f5c493494c03e7a4c943acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5eae3f6-c191-4cc4-a56a-cbfd6647c955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5eae3f6-c191-4cc4-a56a-cbfd6647c955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4ffeb8-015d-40bb-8ab9-fbbf919feb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4ffeb8-015d-40bb-8ab9-fbbf919feb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ddff28a-94b1-4c55-98b4-78f50bb144aa', 'volume_name': 'volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3877e42d-30ad-424a-90e8-3c0c3c8ffbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3877e42d-30ad-424a-90e8-3c0c3c8ffbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8002c1-1ac1-4ec6-beb4-123e95d437e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:50 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Volume 2ddff28a-94b1-4c55-98b4-78f50bb144aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa', 'volume_size': 1} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:50 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d 1073741824" returned: 0 in 0.827s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:50 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d Jul 07 08:30:50 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:50 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d" returned: 0 in 0.600s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1206080525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddff28a-94b1-4c55-98b4-78f50bb144aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8445eb3ba244275a837f2e72b267df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:50Z,use_quota=True,user_id='fe385d128f5c493494c03e7a4c943acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Creating volume 2ddff28a-94b1-4c55-98b4-78f50bb144aa {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:30:50 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:50 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa 1073741824 Jul 07 08:30:50 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d29b55-083c-4968-be7f-df6e344efd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9516e99b-1de3-4eaa-8c99-c76109b477ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:50 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Volume volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d (9e79a0ab-8922-46d1-ae52-5a07bfc4160d): created successfully Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9516e99b-1de3-4eaa-8c99-c76109b477ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (821b003b-c754-41c1-b784-7f66c42aeeb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2106a6bf-258b-4d8a-abeb-20ea9b052e01 tempest-VolumesGetTest-2076882506 None] Created volume successfully. Jul 07 08:30:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-9e79a0ab-8922-46d1-ae52-5a07bfc4160d-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Lock "cinder-9e79a0ab-8922-46d1-ae52-5a07bfc4160d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-quobyte-9e79a0ab-8922-46d1-ae52-5a07bfc4160d" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-9e79a0ab-8922-46d1-ae52-5a07bfc4160d" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:51 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c03d2e-8349-435a-88bb-54f90206964b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:51 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa 1073741824" returned: 0 in 0.860s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:51 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d Jul 07 08:30:51 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:51 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa Jul 07 08:30:51 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:52 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d" returned: 0 in 0.751s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:52 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa" returned: 0 in 0.638s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:30:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:52 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d Jul 07 08:30:52 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8002c1-1ac1-4ec6-beb4-123e95d437e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e625b201-7eea-4930-af07-8ff5c46f03d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:52 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Volume volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa (2ddff28a-94b1-4c55-98b4-78f50bb144aa): created successfully Jul 07 08:30:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e625b201-7eea-4930-af07-8ff5c46f03d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Flow 'volume_create_manager' (e1765eb7-0217-4814-a0e8-574501456803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-10bf163a-faf0-46a0-b261-61adebe48323 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Created volume successfully. Jul 07 08:30:53 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9e79a0ab-8922-46d1-ae52-5a07bfc4160d" returned: 0 in 0.609s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-9e79a0ab-8922-46d1-ae52-5a07bfc4160d" released by "delete_volume" :: held 1.399s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Created reservations ['3296d9f9-df39-4679-876d-e81197a7e732', '34927942-3562-47ae-9aa3-230cc9547603', '5c412c2f-b237-48f2-8254-d2cc9c7d70ae', '94966461-f655-4c1f-beda-bfa5a0dd2800'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:53 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:30:53 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:53 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.678s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:53 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Deleted volume successfully. Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4fca0104-c379-4acb-a73b-1ee0ba58efda tempest-VolumesGetTest-2076882506 None] Lock "cinder-9e79a0ab-8922-46d1-ae52-5a07bfc4160d-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-bf042a39-e0e7-4295-9c63-ba97884afa3c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Lock "cinder-bf042a39-e0e7-4295-9c63-ba97884afa3c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=58,cinder:SELECT=39,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:30:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-quobyte-bf042a39-e0e7-4295-9c63-ba97884afa3c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-bf042a39-e0e7-4295-9c63-ba97884afa3c" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:54 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f374f4b9-0784-4e92-a26b-98d98ffb3bc1]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:54 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c Jul 07 08:30:54 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:54 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c" returned: 0 in 0.747s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:54 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c Jul 07 08:30:54 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:55 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bf042a39-e0e7-4295-9c63-ba97884afa3c" returned: 0 in 0.619s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-bf042a39-e0e7-4295-9c63-ba97884afa3c" released by "delete_volume" :: held 1.408s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:55 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Created reservations ['fe4646a5-c72f-411c-aca3-ec3fde325e2c', '01558808-5401-4c7e-8a61-dba36179b7ec', 'f80e2abc-6f3b-4253-b43b-abbf163b0d10', 'd22c9396-8ff5-4de5-81df-358542599341'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:55 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:30:55 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:56 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.659s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Deleted volume successfully. Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-cee7e523-00aa-4629-ac58-bd98de2960eb-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9a035ff8-0878-454f-8c19-9efe571f6519 tempest-VolumesGetTest-2076882506 None] Lock "cinder-bf042a39-e0e7-4295-9c63-ba97884afa3c-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Lock "cinder-cee7e523-00aa-4629-ac58-bd98de2960eb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-quobyte-cee7e523-00aa-4629-ac58-bd98de2960eb" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-cee7e523-00aa-4629-ac58-bd98de2960eb" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3917a1bc-5ad9-47bf-a907-c9855f78987b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-17742029-c604-49c2-bc7d-694648fac159 req-873730a2-c3a9-49da-a4bc-e974e7be77ef tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-17742029-c604-49c2-bc7d-694648fac159 req-873730a2-c3a9-49da-a4bc-e974e7be77ef tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b449bb3-7641-4623-b75b-4f3e1214a344]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-17742029-c604-49c2-bc7d-694648fac159 req-873730a2-c3a9-49da-a4bc-e974e7be77ef tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:56 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb Jul 07 08:30:56 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:56 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa Jul 07 08:30:56 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:57 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb" returned: 0 in 0.773s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:57 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-17742029-c604-49c2-bc7d-694648fac159 req-873730a2-c3a9-49da-a4bc-e974e7be77ef tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa" returned: 0 in 0.748s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-17742029-c604-49c2-bc7d-694648fac159 req-873730a2-c3a9-49da-a4bc-e974e7be77ef tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.765s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:57 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb Jul 07 08:30:57 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-17742029-c604-49c2-bc7d-694648fac159 req-873730a2-c3a9-49da-a4bc-e974e7be77ef tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93bea9e9-c5f2-4b0d-ada2-4df5113216c3', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:30:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-17742029-c604-49c2-bc7d-694648fac159 req-873730a2-c3a9-49da-a4bc-e974e7be77ef tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] attachment_update completed successfully. Jul 07 08:30:57 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cee7e523-00aa-4629-ac58-bd98de2960eb" returned: 0 in 0.649s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-cee7e523-00aa-4629-ac58-bd98de2960eb" released by "delete_volume" :: held 1.486s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Created reservations ['350dceb9-d4c1-4206-8825-a6a77d6acd23', '6eaacbc9-90bb-4859-8715-53e5a140166b', '5783ba64-809d-4ac2-bcf2-3b1693819a4b', '7de81db5-59d9-441e-ae3a-1fe3900008c9'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:30:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:30:57 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:30:57 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:30:58 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 07 08:30:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.638s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:30:58 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:30:58 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Deleted volume successfully. Jul 07 08:30:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2ed82aa9-c6ba-4322-9fb5-902031aef9e3 tempest-VolumesGetTest-2076882506 None] Lock "cinder-cee7e523-00aa-4629-ac58-bd98de2960eb-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (57c3851c-45e5-4e25-be57-e6e5ff998649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b17737-f9a6-49f1-a2ac-db07d7e53dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b17737-f9a6-49f1-a2ac-db07d7e53dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1342884041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0191bc-5d09-4e54-b3f7-911e3d733443,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:59Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27733733-109a-4f57-a36a-4edece44f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27733733-109a-4f57-a36a-4edece44f86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d8b7a5-f22f-4621-a83f-250b8225ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.image.glance [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Creating Keystone auth plugin from conf {{(pid=87179) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d8b7a5-f22f-4621-a83f-250b8225ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d0191bc-5d09-4e54-b3f7-911e3d733443', 'volume_name': 'volume-2d0191bc-5d09-4e54-b3f7-911e3d733443', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d46b390-eff9-44a8-880b-d0cad3399967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d46b390-eff9-44a8-880b-d0cad3399967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29023941-57c3-4dc9-8cc7-e4ab6de096de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:30:59 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Volume 2d0191bc-5d09-4e54-b3f7-911e3d733443: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d0191bc-5d09-4e54-b3f7-911e3d733443', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Trying to clone 2d0191bc-5d09-4e54-b3f7-911e3d733443 from image d183b53e-6225-438a-8e28-29fd7f440861 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]). {{(pid=87179) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:30:59 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Image download 20.69 MB at 20.69 MB/s Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc9309d-4074-44d4-bb5a-d24209e2d727]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:30:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:00 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD Jul 07 08:31:00 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:00 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD" returned: 0 in 0.719s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:00 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Temporary image d183b53e-6225-438a-8e28-29fd7f440861 is fetched for user a8a8cda3485e4583b8757162d6ddc85e. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:31:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae006b3-18db-4dcc-967e-2abd3daa065f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:00 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD Jul 07 08:31:00 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:01 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1342884041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0191bc-5d09-4e54-b3f7-911e3d733443,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:30:59Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Creating volume 2d0191bc-5d09-4e54-b3f7-911e3d733443 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:01 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:31:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:01 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 1073741824 Jul 07 08:31:01 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:02 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 1073741824" returned: 0 in 0.837s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:02 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 Jul 07 08:31:02 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:02 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443" returned: 0 in 0.613s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:02 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Attempting download of d183b53e-6225-438a-8e28-29fd7f440861 ((None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}])) to volume 2d0191bc-5d09-4e54-b3f7-911e3d733443. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:31:03 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06e344d-fe85-457f-88f5-f05573bd5e28]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_cfkfsgmm {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:03 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_cfkfsgmm Jul 07 08:31:03 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-cbc33834-2896-4de8-a0e1-cbd5053f98d2 req-8bde3f0f-f885-4f38-b9c3-6ac5629555ff tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Terminate volume connection completed successfully. Jul 07 08:31:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-cbc33834-2896-4de8-a0e1-cbd5053f98d2 req-8bde3f0f-f885-4f38-b9c3-6ac5629555ff tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Deleting attachment 93bea9e9-c5f2-4b0d-ada2-4df5113216c3. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:31:03 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_cfkfsgmm" returned: 0 in 0.712s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_cfkfsgmm {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:03 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_cfkfsgmm Jul 07 08:31:03 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:04 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_cfkfsgmm" returned: 1 in 0.705s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d183b53e-6225-438a-8e28-29fd7f440861_cfkfsgmm' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[73398b9e-59d4-487f-8ec2-25f606e420e1]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:04 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD Jul 07 08:31:04 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:04 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:04 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:05 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD" returned: 0 in 0.720s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] d183b53e-6225-438a-8e28-29fd7f440861 was qcow2, converting to raw {{(pid=87179) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:05 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 Jul 07 08:31:05 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:05 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.647s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Acquiring lock "cinder-2ddff28a-94b1-4c55-98b4-78f50bb144aa-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "cinder-2ddff28a-94b1-4c55-98b4-78f50bb144aa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Acquiring lock "cinder-quobyte-2ddff28a-94b1-4c55-98b4-78f50bb144aa" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "cinder-quobyte-2ddff28a-94b1-4c55-98b4-78f50bb144aa" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f392757f-d118-40b4-8ef3-356e10882662]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:05 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa Jul 07 08:31:05 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:06 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa" returned: 0 in 0.853s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:06 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa Jul 07 08:31:06 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:06 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443" returned: 0 in 1.768s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:06 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d183b53e-6225-438a-8e28-29fd7f440861_ka63a3z4devstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:31:06 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Converted 112.00 MB image at 63.30 MB/s Jul 07 08:31:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:06 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 1G Jul 07 08:31:06 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:07 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2ddff28a-94b1-4c55-98b4-78f50bb144aa" returned: 0 in 0.641s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "cinder-quobyte-2ddff28a-94b1-4c55-98b4-78f50bb144aa" released by "delete_volume" :: held 1.534s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Created reservations ['65be74af-e9c5-4c64-91c8-b99f52c61953', '7760a69c-24bb-4d7c-ac65-afc84cee7b23', '7a25533a-19b8-49e4-aad8-9d49072f975b', 'dd4c9799-0814-4f0d-93de-1e6011245c10'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:07 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:07 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:07 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 1G" returned: 0 in 0.679s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5952db54-5210-48cb-9529-974a18df9ad3]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:07 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 Jul 07 08:31:07 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:07 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.680s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:07 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Deleted volume successfully. Jul 07 08:31:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-bded769d-44f6-449e-ad6d-4164bb8a1c82 tempest-TestServerVolumeAttachScenarioOldVersion-784088893 None] Lock "cinder-2ddff28a-94b1-4c55-98b4-78f50bb144aa-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:08 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443" returned: 0 in 0.771s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:08 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 Jul 07 08:31:08 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:09 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443" returned: 1 in 0.754s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Downloaded image d183b53e-6225-438a-8e28-29fd7f440861 ((None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}])) to volume 2d0191bc-5d09-4e54-b3f7-911e3d733443 successfully. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Temporary image d183b53e-6225-438a-8e28-29fd7f440861 for user a8a8cda3485e4583b8757162d6ddc85e is deleted. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Marking volume 2d0191bc-5d09-4e54-b3f7-911e3d733443 as bootable. {{(pid=87179) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Copying metadata from image d183b53e-6225-438a-8e28-29fd7f440861 to 2d0191bc-5d09-4e54-b3f7-911e3d733443. {{(pid=87179) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Creating volume glance metadata for volume 2d0191bc-5d09-4e54-b3f7-911e3d733443 backed by image d183b53e-6225-438a-8e28-29fd7f440861 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87179) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29023941-57c3-4dc9-8cc7-e4ab6de096de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0191bc-5d09-4e54-b3f7-911e3d733443', 'volume_size': 1, 'image_id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d183b53e-6225-438a-8e28-29fd7f440861', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b14047ac51a749f3be2439efac803254', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd183b53e-6225-438a-8e28-29fd7f440861', 'created_at': datetime.datetime(2026, 7, 7, 6, 6, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d183b53e-6225-438a-8e28-29fd7f440861/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5020b0ae-a7f4-42b0-be04-05e3c22e8bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:09 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Volume volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 (2d0191bc-5d09-4e54-b3f7-911e3d733443): created successfully Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5020b0ae-a7f4-42b0-be04-05e3c22e8bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:09 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (57c3851c-45e5-4e25-be57-e6e5ff998649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:09 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6fb5622a-a9d2-4b2b-8e8e-cbf12b92469e tempest-VolumesGetTest-2076882506 None] Created volume successfully. Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (27a65b97-97f0-45bb-8a78-3082d6128ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2280a40-dd09-49d4-9299-e731cea75164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2280a40-dd09-49d4-9299-e731cea75164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1839724634',display_name='tempest-VolumesGetTest-Volume-1076813268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4c71cb-7425-451a-8c42-24963d4c7200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:10Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e5f23b-4b6f-47d0-b485-37b51e9ee398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e5f23b-4b6f-47d0-b485-37b51e9ee398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574b0de1-8098-4659-b773-639b30cfa144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574b0de1-8098-4659-b773-639b30cfa144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4c71cb-7425-451a-8c42-24963d4c7200', 'volume_name': 'volume-0e4c71cb-7425-451a-8c42-24963d4c7200', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949a5c85-4a48-4bd2-988a-19bf6557546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949a5c85-4a48-4bd2-988a-19bf6557546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27415ffa-65dd-483e-9945-8036992a94df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:10 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Volume 0e4c71cb-7425-451a-8c42-24963d4c7200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4c71cb-7425-451a-8c42-24963d4c7200', 'volume_size': 1} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1839724634',display_name='tempest-VolumesGetTest-Volume-1076813268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4c71cb-7425-451a-8c42-24963d4c7200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c62afdb4fe44bfb895888b59768c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:10Z,use_quota=True,user_id='a8a8cda3485e4583b8757162d6ddc85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Creating volume 0e4c71cb-7425-451a-8c42-24963d4c7200 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:10 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:31:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:10 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200 1073741824 Jul 07 08:31:10 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:11 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200 1073741824" returned: 0 in 0.831s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:11 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200 Jul 07 08:31:11 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:12 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200" returned: 0 in 0.634s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27415ffa-65dd-483e-9945-8036992a94df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4c71cb-7425-451a-8c42-24963d4c7200', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf11a37-7341-428a-b36b-e8cb0af3af0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:12 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Volume volume-0e4c71cb-7425-451a-8c42-24963d4c7200 (0e4c71cb-7425-451a-8c42-24963d4c7200): created successfully Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf11a37-7341-428a-b36b-e8cb0af3af0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Flow 'volume_create_manager' (27a65b97-97f0-45bb-8a78-3082d6128ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:12 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-806d7925-71e8-40a0-961f-e31206a59dfd tempest-VolumesGetTest-2076882506 None] Created volume successfully. Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-0e4c71cb-7425-451a-8c42-24963d4c7200-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Lock "cinder-0e4c71cb-7425-451a-8c42-24963d4c7200-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-quobyte-0e4c71cb-7425-451a-8c42-24963d4c7200" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-0e4c71cb-7425-451a-8c42-24963d4c7200" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6045c313-b921-42b1-b55b-945f8f21133a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:12 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200 Jul 07 08:31:12 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:13 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200" returned: 0 in 0.730s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:13 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200 Jul 07 08:31:13 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:14 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-0e4c71cb-7425-451a-8c42-24963d4c7200" returned: 0 in 0.629s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-0e4c71cb-7425-451a-8c42-24963d4c7200" released by "delete_volume" :: held 1.409s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Created reservations ['3f013cfe-5ba8-4b7c-9203-7af4eee5c7fc', '870654ec-3bf6-41d2-bb5f-c609a986e4c8', 'b5c1a730-6399-40c7-b99e-abb18fbfc7b9', '46cfebb9-58c2-4fb5-bdf1-04cd1510e741'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:14 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:14 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:14 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.623s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Deleted volume successfully. Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-2d0191bc-5d09-4e54-b3f7-911e3d733443-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c0763f4a-c435-4dce-a135-505b650f5c7d tempest-VolumesGetTest-2076882506 None] Lock "cinder-0e4c71cb-7425-451a-8c42-24963d4c7200-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Lock "cinder-2d0191bc-5d09-4e54-b3f7-911e3d733443-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Acquiring lock "cinder-quobyte-2d0191bc-5d09-4e54-b3f7-911e3d733443" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-2d0191bc-5d09-4e54-b3f7-911e3d733443" acquired by "delete_volume" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:15 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb96ab4b-0594-4e7c-bc1f-cef691604036]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:15 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 Jul 07 08:31:15 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:15 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443" returned: 0 in 0.755s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:15 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 Jul 07 08:31:15 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:16 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443" returned: 1 in 0.784s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:31:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:16 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443 Jul 07 08:31:16 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:17 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d0191bc-5d09-4e54-b3f7-911e3d733443" returned: 0 in 0.647s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Lock "cinder-quobyte-2d0191bc-5d09-4e54-b3f7-911e3d733443" released by "delete_volume" :: held 2.242s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:17 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Created reservations ['f03b85be-8065-48d7-a2cb-0b7459c55ef2', 'e7bc3cf3-10ef-4ba6-a571-fc1ed57fd4a0', '1d920046-ecb7-4c84-9181-96175ec2d505', '3318a94a-5dee-4449-827a-de6327630675'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:17 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:17 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:18 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:18 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:18 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Deleted volume successfully. Jul 07 08:31:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9b0d6e95-bfab-4172-a2e4-1f2d2b74a21b tempest-VolumesGetTest-2076882506 None] Lock "cinder-2d0191bc-5d09-4e54-b3f7-911e3d733443-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Flow 'volume_create_manager' (d13fafb2-8ec8-45d7-8eab-f76686dcab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070a5998-57a8-4301-b8f6-01ac3d38a64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070a5998-57a8-4301-b8f6-01ac3d38a64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1970921495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d268780-69a9-4231-9a70-c1be4927a3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe261ec64840739acb7b3266f20505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:21Z,use_quota=True,user_id='71bab76ea65446e5b41364a97ca7a850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af94938-d2e6-4548-b94f-09a0eb2b14ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af94938-d2e6-4548-b94f-09a0eb2b14ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0496f70-d62b-4345-b414-632d8520731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0496f70-d62b-4345-b414-632d8520731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d268780-69a9-4231-9a70-c1be4927a3ba', 'volume_name': 'volume-7d268780-69a9-4231-9a70-c1be4927a3ba', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736fc947-6ed9-4fbf-94ec-e53cbffcf0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736fc947-6ed9-4fbf-94ec-e53cbffcf0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7810e0f-e3b5-45a9-a29e-66adde129b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:21 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Volume 7d268780-69a9-4231-9a70-c1be4927a3ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d268780-69a9-4231-9a70-c1be4927a3ba', 'volume_size': 1} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1970921495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d268780-69a9-4231-9a70-c1be4927a3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe261ec64840739acb7b3266f20505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:21Z,use_quota=True,user_id='71bab76ea65446e5b41364a97ca7a850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Creating volume 7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:21 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:31:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:21 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba 1073741824 Jul 07 08:31:21 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:22 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba 1073741824" returned: 0 in 0.957s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:22 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba Jul 07 08:31:22 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:23 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba" returned: 0 in 0.671s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7810e0f-e3b5-45a9-a29e-66adde129b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d268780-69a9-4231-9a70-c1be4927a3ba', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b294f-f35d-4783-9b04-fabaf6c7d2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:23 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Volume volume-7d268780-69a9-4231-9a70-c1be4927a3ba (7d268780-69a9-4231-9a70-c1be4927a3ba): created successfully Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b294f-f35d-4783-9b04-fabaf6c7d2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Flow 'volume_create_manager' (d13fafb2-8ec8-45d7-8eab-f76686dcab77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:23 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8ef6b16b-f5f9-45f9-8984-6417f16b332c tempest-VolumesSnapshotListTestJSON-183965499 None] Created volume successfully. Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Creating offline snapshot 491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 of volume 7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d90997a-b4b6-4339-9443-de09071bfc66]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:23 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba Jul 07 08:31:23 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:24 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba" returned: 0 in 0.755s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:24 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 1G Jul 07 08:31:24 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:25 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 1G" returned: 0 in 0.857s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d268780-69a9-4231-9a70-c1be4927a3ba -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:25 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d268780-69a9-4231-9a70-c1be4927a3ba -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 Jul 07 08:31:25 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:25 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d268780-69a9-4231-9a70-c1be4927a3ba -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" returned: 0 in 0.671s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:25 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 is being set with open permissions: ugo+rw Jul 07 08:31:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:25 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 Jul 07 08:31:25 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (e13d7e51-9cc6-4d87-a394-c257cdb0d5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b837e295-c6d4-4807-a899-9b2572fe71e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b837e295-c6d4-4807-a899-9b2572fe71e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2097748321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc205167-9249-4f80-9528-373cd2cbbab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:26Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377bb86f-9551-4400-9efc-ddf436702260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377bb86f-9551-4400-9efc-ddf436702260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef95ebeb-d921-47f6-aa8a-f358e6cd5055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef95ebeb-d921-47f6-aa8a-f358e6cd5055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc205167-9249-4f80-9528-373cd2cbbab1', 'volume_name': 'volume-bc205167-9249-4f80-9528-373cd2cbbab1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca4c67-42c8-4187-b6aa-224c5ee97be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca4c67-42c8-4187-b6aa-224c5ee97be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d746a1-3ae8-479b-829f-46e35ed7736e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:26 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume bc205167-9249-4f80-9528-373cd2cbbab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc205167-9249-4f80-9528-373cd2cbbab1', 'volume_size': 1} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:26 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" returned: 0 in 0.708s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:26 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.info Jul 07 08:31:26 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:27 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.info" returned: 0 in 0.631s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:27 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.info is being set with open permissions: ugo+rw Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:27 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.info Jul 07 08:31:27 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:27 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.info" returned: 0 in 0.623s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.330s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2097748321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc205167-9249-4f80-9528-373cd2cbbab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:26Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Creating volume bc205167-9249-4f80-9528-373cd2cbbab1 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:27 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:31:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:27 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 1073741824 Jul 07 08:31:27 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:27 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d44a163c-feb0-4b01-914c-e2dc1749da7a tempest-VolumesSnapshotListTestJSON-183965499 None] Create snapshot completed successfully Jul 07 08:31:28 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 1073741824" returned: 0 in 0.819s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:28 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 Jul 07 08:31:28 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:29 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1" returned: 0 in 0.651s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.476s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d746a1-3ae8-479b-829f-46e35ed7736e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc205167-9249-4f80-9528-373cd2cbbab1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b663e365-cd60-45e4-9bbe-0e0be66a5164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Creating offline snapshot 98820e8b-febd-44f3-ba80-3f29ef3cda53 of volume 7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:31:29 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume volume-bc205167-9249-4f80-9528-373cd2cbbab1 (bc205167-9249-4f80-9528-373cd2cbbab1): created successfully Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b663e365-cd60-45e4-9bbe-0e0be66a5164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (e13d7e51-9cc6-4d87-a394-c257cdb0d5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aed81f-adbf-49cf-87da-e01a6e576370]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-0ac14e4a-f230-456e-972a-afd016bbf8f2 tempest-CreateVolumesFromSnapshotTest-155367425 None] Created volume successfully. Jul 07 08:31:29 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 Jul 07 08:31:29 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:30 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" returned: 0 in 0.727s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d268780-69a9-4231-9a70-c1be4927a3ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:31:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:30 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 1G Jul 07 08:31:30 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:31 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 1G" returned: 0 in 0.792s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:31 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 Jul 07 08:31:31 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:31 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53" returned: 0 in 0.669s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:31 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 is being set with open permissions: ugo+rw Jul 07 08:31:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:31 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 Jul 07 08:31:31 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:32 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53" returned: 0 in 0.630s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.602s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Creating offline snapshot c646aba7-106f-454f-b643-f7a703a826a4 of volume bc205167-9249-4f80-9528-373cd2cbbab1 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:31:32 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c914046-4c1a-4952-b937-7ed4573d9071]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:32 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f03b9a62-c82a-4217-958f-4a7f00db9596 tempest-VolumesSnapshotListTestJSON-183965499 None] Create snapshot completed successfully Jul 07 08:31:32 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 Jul 07 08:31:32 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:33 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1" returned: 0 in 0.739s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:33 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 1G Jul 07 08:31:33 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:34 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 1G" returned: 0 in 0.862s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc205167-9249-4f80-9528-373cd2cbbab1 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:34 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc205167-9249-4f80-9528-373cd2cbbab1 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 Jul 07 08:31:34 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:34 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc205167-9249-4f80-9528-373cd2cbbab1 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:34 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 is being set with open permissions: ugo+rw Jul 07 08:31:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:34 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 Jul 07 08:31:34 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:35 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4" returned: 0 in 0.612s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:35 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.info Jul 07 08:31:35 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:35 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.info" returned: 0 in 0.628s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:35 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.info is being set with open permissions: ugo+rw Jul 07 08:31:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:36 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.info Jul 07 08:31:36 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:36 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.info" returned: 0 in 0.617s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.213s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.301s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Creating offline snapshot cd0b3151-f5af-4fdc-b227-f3c3e84a45ea of volume 7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:31:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5175eb64-307d-4a45-83e0-7ffdfbb212bd]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5b359d95-f866-4bfd-b193-65d7570c40ff tempest-CreateVolumesFromSnapshotTest-155367425 None] Create snapshot completed successfully Jul 07 08:31:36 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 Jul 07 08:31:36 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:37 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53" returned: 0 in 0.770s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d268780-69a9-4231-9a70-c1be4927a3ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:37 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea 1G Jul 07 08:31:37 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (99e73c81-fc9c-4699-9fb9-e20bff8a0934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9883ce38-03be-473b-b704-adf752446f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9883ce38-03be-473b-b704-adf752446f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-875979965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742dd737-ae9e-4dca-8d74-98ac8865b9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:37Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bf34ac-1fbe-4ff3-8ae0-79ad2fbe2c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bf34ac-1fbe-4ff3-8ae0-79ad2fbe2c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573970d-ab0e-4930-9a13-17a100110236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573970d-ab0e-4930-9a13-17a100110236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '742dd737-ae9e-4dca-8d74-98ac8865b9ec', 'volume_name': 'volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91d9fb9-5d7f-40cd-9a5c-228482bd646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91d9fb9-5d7f-40cd-9a5c-228482bd646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afff13b2-94ea-4236-bf16-f4afb6b8e660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume 742dd737-ae9e-4dca-8d74-98ac8865b9ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec', 'volume_size': 1} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (396d5893-7476-4c1f-9e31-9d22c50bc212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d913e1b-b73b-41eb-b49e-11c614f4584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d913e1b-b73b-41eb-b49e-11c614f4584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739604172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882ef7b0-e6a1-4c16-aaa5-93eb35b2660d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:38Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543b7eb7-23aa-4af6-bad8-9f629a4b971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543b7eb7-23aa-4af6-bad8-9f629a4b971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e584071b-8008-472c-ab3c-c82be39daa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e584071b-8008-472c-ab3c-c82be39daa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882ef7b0-e6a1-4c16-aaa5-93eb35b2660d', 'volume_name': 'volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9daa5db-f9f0-449e-8b8b-225af1df6601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9daa5db-f9f0-449e-8b8b-225af1df6601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9735ecad-655f-4ef3-9e93-31a1df755b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:37 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume 882ef7b0-e6a1-4c16-aaa5-93eb35b2660d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d', 'volume_size': 1} Jul 07 08:31:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (7991171b-5651-4c7b-ad63-9e1d72f6aba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8146b241-2a8e-443b-b7c9-ad28447893b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8146b241-2a8e-443b-b7c9-ad28447893b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-869155820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74816cfd-aa62-47ac-befb-58ddbafc9012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:38Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39b8e8f-9ce3-4229-b495-a2668c8a3144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39b8e8f-9ce3-4229-b495-a2668c8a3144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b074a2-908c-443f-9af1-5e2b6cf6a554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b074a2-908c-443f-9af1-5e2b6cf6a554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74816cfd-aa62-47ac-befb-58ddbafc9012', 'volume_name': 'volume-74816cfd-aa62-47ac-befb-58ddbafc9012', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5217a809-2343-4ba5-8c2c-88a748a36832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5217a809-2343-4ba5-8c2c-88a748a36832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0a5df-6955-425d-a32f-a0b49842b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume 74816cfd-aa62-47ac-befb-58ddbafc9012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74816cfd-aa62-47ac-befb-58ddbafc9012', 'volume_size': 1} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:38 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea 1G" returned: 0 in 0.962s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:38 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea Jul 07 08:31:38 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (9e667e5b-f543-4e1d-afc5-aaf8097a0bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506006ea-231a-4464-aa07-edc70641e95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506006ea-231a-4464-aa07-edc70641e95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1855064829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:39Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2890f47e-2513-4569-b35f-73d676445259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2890f47e-2513-4569-b35f-73d676445259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88103d83-06fc-4779-93f6-11420408f6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88103d83-06fc-4779-93f6-11420408f6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb', 'volume_name': 'volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b963d0a0-6326-4549-b066-0d04d0c426b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b963d0a0-6326-4549-b066-0d04d0c426b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fcbde5-72b5-403b-9ad7-0d4e33f30d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb', 'volume_size': 1} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (b3fd6d79-7606-4a06-8965-a0823d7f2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2673a062-4b29-4b2b-a82c-f2797ec33042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2673a062-4b29-4b2b-a82c-f2797ec33042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164269661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397b7b7a-82f8-441e-a3b4-8be4a1918694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:39Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37b00e8-8d2e-4fdb-b2ed-3f9f489c15cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37b00e8-8d2e-4fdb-b2ed-3f9f489c15cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17da566-5a16-400c-9fe8-4307a2bad480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17da566-5a16-400c-9fe8-4307a2bad480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397b7b7a-82f8-441e-a3b4-8be4a1918694', 'volume_name': 'volume-397b7b7a-82f8-441e-a3b4-8be4a1918694', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32e2180-544a-435b-88a1-3523c646d577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32e2180-544a-435b-88a1-3523c646d577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239f3a3c-7a43-4c59-bad8-093b4d30a2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:39 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume 397b7b7a-82f8-441e-a3b4-8be4a1918694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397b7b7a-82f8-441e-a3b4-8be4a1918694', 'volume_size': 1} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:39 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea" returned: 0 in 0.721s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:39 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea is being set with open permissions: ugo+rw Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:39 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea Jul 07 08:31:39 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:39 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea" returned: 0 in 0.623s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.164s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.190s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-875979965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742dd737-ae9e-4dca-8d74-98ac8865b9ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:37Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Creating volume 742dd737-ae9e-4dca-8d74-98ac8865b9ec {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:39 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:31:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:39 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec 1073741824 Jul 07 08:31:39 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:39 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5f159bac-afe6-4829-be2c-41e9f2153d2a tempest-VolumesSnapshotListTestJSON-183965499 None] Create snapshot completed successfully Jul 07 08:31:40 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec 1073741824" returned: 0 in 0.770s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:40 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec Jul 07 08:31:40 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:41 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec" returned: 0 in 0.630s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.289s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739604172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882ef7b0-e6a1-4c16-aaa5-93eb35b2660d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:38Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Creating volume 882ef7b0-e6a1-4c16-aaa5-93eb35b2660d {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:41 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afff13b2-94ea-4236-bf16-f4afb6b8e660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872b0bb2-c572-4545-b8aa-85e59c01e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:41 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d 1073741824 Jul 07 08:31:41 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:41 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec (742dd737-ae9e-4dca-8d74-98ac8865b9ec): created successfully Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872b0bb2-c572-4545-b8aa-85e59c01e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (99e73c81-fc9c-4699-9fb9-e20bff8a0934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:41 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-872c2bdc-26e3-438d-92d4-39d07812e544 tempest-CreateVolumesFromSnapshotTest-155367425 None] Created volume successfully. Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-cd0b3151-f5af-4fdc-b227-f3c3e84a45ea-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-cd0b3151-f5af-4fdc-b227-f3c3e84a45ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-quobyte-cd0b3151-f5af-4fdc-b227-f3c3e84a45ea" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-cd0b3151-f5af-4fdc-b227-f3c3e84a45ea" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Deleting offline snapshot cd0b3151-f5af-4fdc-b227-f3c3e84a45ea of volume 7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] snapshot_file for this snap is: volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d340c0-2647-4ff3-8d15-f7608fdb68ef]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:41 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea Jul 07 08:31:41 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:42 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d 1073741824" returned: 0 in 0.841s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:42 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d Jul 07 08:31:42 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:42 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea" returned: 0 in 0.803s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d268780-69a9-4231-9a70-c1be4927a3ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dac4f7a-118e-483b-9cd8-114b7e9013a5]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:42 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 Jul 07 08:31:42 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:42 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d" returned: 0 in 0.690s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.513s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-869155820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74816cfd-aa62-47ac-befb-58ddbafc9012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:38Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Creating volume 74816cfd-aa62-47ac-befb-58ddbafc9012 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:42 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:42 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012 1073741824 Jul 07 08:31:42 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9735ecad-655f-4ef3-9e93-31a1df755b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadc21d6-abef-41dd-89fb-3294b828a10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:42 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d (882ef7b0-e6a1-4c16-aaa5-93eb35b2660d): created successfully Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadc21d6-abef-41dd-89fb-3294b828a10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (396d5893-7476-4c1f-9e31-9d22c50bc212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:42 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d733e668-8e69-4087-b921-5ef966395afc tempest-CreateVolumesFromSnapshotTest-155367425 None] Created volume successfully. Jul 07 08:31:43 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53" returned: 0 in 0.773s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d268780-69a9-4231-9a70-c1be4927a3ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:31:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:43 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea Jul 07 08:31:43 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:43 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012 1073741824" returned: 0 in 0.918s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:43 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012 Jul 07 08:31:43 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:43 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea" returned: 0 in 0.847s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:43 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea Jul 07 08:31:43 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:44 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012" returned: 0 in 0.634s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.761s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1855064829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:39Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Creating volume ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:44 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:44 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb 1073741824 Jul 07 08:31:44 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0a5df-6955-425d-a32f-a0b49842b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74816cfd-aa62-47ac-befb-58ddbafc9012', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce6808d-0a31-4833-887e-d4a20b79612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:44 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume volume-74816cfd-aa62-47ac-befb-58ddbafc9012 (74816cfd-aa62-47ac-befb-58ddbafc9012): created successfully Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce6808d-0a31-4833-887e-d4a20b79612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (7991171b-5651-4c7b-ad63-9e1d72f6aba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:44 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6a2c3f1d-23e4-4a9a-b978-a01f928cfc72 tempest-CreateVolumesFromSnapshotTest-155367425 None] Created volume successfully. Jul 07 08:31:44 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.cd0b3151-f5af-4fdc-b227-f3c3e84a45ea" returned: 0 in 0.709s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-cd0b3151-f5af-4fdc-b227-f3c3e84a45ea" released by "_delete_snapshot" :: held 3.225s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" released by "delete_snapshot" :: held 3.249s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Created reservations ['42edc824-8116-462a-9bc1-ca01bb748f67', '9821f308-a9ee-4470-9f5c-00532409586f', '9994544d-8da0-4598-833b-e013d7c9f835', '85b79299-53f9-4de0-81fc-19bba63edf7d'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:44 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Delete snapshot completed successfully. Jul 07 08:31:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8d6aa897-4b14-481c-bd22-fd48265efd04 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-cd0b3151-f5af-4fdc-b227-f3c3e84a45ea-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:45 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb 1073741824" returned: 0 in 0.841s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:45 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb Jul 07 08:31:45 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-98820e8b-febd-44f3-ba80-3f29ef3cda53-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-98820e8b-febd-44f3-ba80-3f29ef3cda53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-quobyte-98820e8b-febd-44f3-ba80-3f29ef3cda53" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-98820e8b-febd-44f3-ba80-3f29ef3cda53" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Deleting offline snapshot 98820e8b-febd-44f3-ba80-3f29ef3cda53 of volume 7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] snapshot_file for this snap is: volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[01910f57-9693-425f-9c6e-bd6e6cff9b75]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:45 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 Jul 07 08:31:45 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:45 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb" returned: 0 in 0.654s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.960s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1164269661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397b7b7a-82f8-441e-a3b4-8be4a1918694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc3890e6c28452994fd24cfdae187c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:31:39Z,use_quota=True,user_id='4a071b40ad034338b08cdb94bcb1f048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Creating volume 397b7b7a-82f8-441e-a3b4-8be4a1918694 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:31:45 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:45 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=85,cinder:SELECT=88,cinder:INSERT=24,cinder:DELETE=11 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:31:46 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 1073741824 Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fcbde5-72b5-403b-9ad7-0d4e33f30d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:46 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c59da7f-1203-45f1-9820-cd816afbd4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:46 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb (ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb): created successfully Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c59da7f-1203-45f1-9820-cd816afbd4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (9e667e5b-f543-4e1d-afc5-aaf8097a0bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:46 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-42923d66-072a-4e26-ab40-eb882d115b8a tempest-CreateVolumesFromSnapshotTest-155367425 None] Created volume successfully. Jul 07 08:31:46 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53" returned: 0 in 0.775s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d268780-69a9-4231-9a70-c1be4927a3ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d6554-a987-4ff0-9827-d42bdc904884]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:46 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 Jul 07 08:31:46 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:46 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 1073741824" returned: 0 in 0.820s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:46 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 Jul 07 08:31:46 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:47 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" returned: 0 in 0.807s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d268780-69a9-4231-9a70-c1be4927a3ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:47 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 Jul 07 08:31:47 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:47 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694" returned: 0 in 0.662s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239f3a3c-7a43-4c59-bad8-093b4d30a2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397b7b7a-82f8-441e-a3b4-8be4a1918694', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e182630-c0c7-4e76-b8be-ceb40bfd6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:31:47 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Volume volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 (397b7b7a-82f8-441e-a3b4-8be4a1918694): created successfully Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e182630-c0c7-4e76-b8be-ceb40bfd6a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Flow 'volume_create_manager' (b3fd6d79-7606-4a06-8965-a0823d7f2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:31:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c91cb502-794a-40c6-9587-68fa91d35b24 tempest-CreateVolumesFromSnapshotTest-155367425 None] Created volume successfully. Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-397b7b7a-82f8-441e-a3b4-8be4a1918694-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-397b7b7a-82f8-441e-a3b4-8be4a1918694-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-quobyte-397b7b7a-82f8-441e-a3b4-8be4a1918694" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-397b7b7a-82f8-441e-a3b4-8be4a1918694" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[debbeaa8-f557-4887-81af-8344f1348c06]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:48 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53" returned: 0 in 0.814s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:48 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 Jul 07 08:31:48 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:48 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53 Jul 07 08:31:48 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:48 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.98820e8b-febd-44f3-ba80-3f29ef3cda53" returned: 0 in 0.643s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:48 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694" returned: 0 in 0.775s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-98820e8b-febd-44f3-ba80-3f29ef3cda53" released by "_delete_snapshot" :: held 3.143s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" released by "delete_snapshot" :: held 3.168s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:48 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694 Jul 07 08:31:48 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Created reservations ['ba65d337-e363-43ef-8aaf-176853f316bb', '684105c1-f8ac-47a4-88da-0035092394cd', '649f0f6a-93c6-4b2d-ae02-153d198d9644', '58b787b4-c3bf-4d8e-80d3-88e6e0a06ee0'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:48 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Delete snapshot completed successfully. Jul 07 08:31:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af41c13f-51c7-437a-a5a5-a798116a9ef8 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-98820e8b-febd-44f3-ba80-3f29ef3cda53-delete_snapshot" released by "delete_snapshot" :: held 3.304s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:49 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-397b7b7a-82f8-441e-a3b4-8be4a1918694" returned: 0 in 0.628s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-397b7b7a-82f8-441e-a3b4-8be4a1918694" released by "delete_volume" :: held 1.441s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Created reservations ['6b1cb394-4ed8-47be-94fa-8d43edad2e74', 'b9eb0e61-3058-4cb7-bd28-e9621ea22638', 'e1fc7ca2-f894-4c7d-be54-d5cf5125f239', '1a67f563-099f-4626-b5e4-071b6563c9a3'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:49 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:49 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-quobyte-491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Deleting offline snapshot 491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 of volume 7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] snapshot_file for this snap is: volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a29636-ddf4-48a5-9682-5227dae76935]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:49 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 Jul 07 08:31:49 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:50 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.665s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Deleted volume successfully. Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c812614b-cf46-4d38-8a88-2940ca8aad9b tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-397b7b7a-82f8-441e-a3b4-8be4a1918694-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-quobyte-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbe0b16-e3ab-4f9c-aaa3-be8a80ee2680]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:50 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb Jul 07 08:31:50 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:50 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" returned: 0 in 0.774s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d268780-69a9-4231-9a70-c1be4927a3ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa51689-7d1a-4f41-9355-87dbd8bdfde3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:50 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba Jul 07 08:31:50 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:51 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb" returned: 0 in 0.764s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:51 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb Jul 07 08:31:51 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:51 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba" returned: 0 in 0.742s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:51 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 Jul 07 08:31:51 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:51 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb" released by "delete_volume" :: held 1.475s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Created reservations ['5a5c6a78-cb97-4a21-a307-67df9d323cb4', 'a1c0c6db-791e-44ba-a2dd-8ab766bde2eb', '72be1c96-0638-4f4e-b06e-b8408f81bd38', '177aa54c-832c-46ed-9bba-e07c71b247d6'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:51 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:51 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:52 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" returned: 0 in 0.752s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:52 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179 Jul 07 08:31:52 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-74816cfd-aa62-47ac-befb-58ddbafc9012-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-74816cfd-aa62-47ac-befb-58ddbafc9012-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:52 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.641s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-quobyte-74816cfd-aa62-47ac-befb-58ddbafc9012" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Deleted volume successfully. Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-74816cfd-aa62-47ac-befb-58ddbafc9012" acquired by "delete_volume" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e4392fbd-dc90-4df3-bbe6-6031e2cc15e1 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-ef0ecb13-ce4a-4939-8beb-b82bbbd7e2fb-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c29a1cd-1af3-4e19-a91b-c264bf05b38f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:52 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012 Jul 07 08:31:52 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:52 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba.491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" returned: 0 in 0.682s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179" released by "_delete_snapshot" :: held 3.063s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" released by "delete_snapshot" :: held 3.094s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:52 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Created reservations ['0cd27d11-de5f-481c-8272-95c410d5f2e6', '651f82ab-762c-4ff5-ab15-cf764a82f462', '42f69dd6-47c4-464e-9ca0-3ce5a0b255e1', '956ceffa-d52c-4e28-a9cd-b23f0dd2fec0'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:53 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Delete snapshot completed successfully. Jul 07 08:31:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aab2811a-861a-43a0-b4a1-ad1291ccba10 tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-491ea1bc-63e6-4b8e-a7f3-87f6bc8f0179-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:53 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012" returned: 0 in 0.771s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:53 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012 Jul 07 08:31:53 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:53 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-74816cfd-aa62-47ac-befb-58ddbafc9012" returned: 0 in 0.621s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-74816cfd-aa62-47ac-befb-58ddbafc9012" released by "delete_volume" :: held 1.433s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:53 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Created reservations ['d11b2b3a-6866-45f4-8a04-907ebe8db583', 'dbcb463a-c30c-4acb-a6c4-3f94d8f72c36', 'e4e6f683-53fd-45f8-9006-b3bc66ca2906', '45e4e540-1397-426b-84ab-b0d825354e85'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:53 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=96,cinder:INSERT=35,cinder:UPDATE=118,cinder:DELETE=10 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-7d268780-69a9-4231-9a70-c1be4927a3ba-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:54 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:54 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-7d268780-69a9-4231-9a70-c1be4927a3ba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[83407a9c-84dc-4b70-bb5c-4133f6cf2c6f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:54 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba Jul 07 08:31:54 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:54 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.649s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:54 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Deleted volume successfully. Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b872e71-4109-4632-b927-f9dbe6440636 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-74816cfd-aa62-47ac-befb-58ddbafc9012-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-quobyte-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[52413f24-b1e0-4910-9613-3036195eaacf]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:54 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d Jul 07 08:31:54 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:54 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba" returned: 0 in 0.770s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:55 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba Jul 07 08:31:55 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:55 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d" returned: 0 in 0.740s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:55 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d Jul 07 08:31:55 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:55 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d268780-69a9-4231-9a70-c1be4927a3ba" returned: 0 in 0.627s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-quobyte-7d268780-69a9-4231-9a70-c1be4927a3ba" released by "delete_volume" :: held 1.464s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Created reservations ['a774deb5-c002-4232-bd69-5c98a7fe2f30', '4a6f12bc-9b74-42a6-b436-830e5f8d8409', '5e1da374-464e-42db-a353-d236ea8a242b', 'af62f353-0384-490a-9ad4-1acb44daf62b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:55 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:55 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:56 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d" returned: 0 in 0.642s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d" released by "delete_volume" :: held 1.421s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Created reservations ['357ce10a-ec01-4f43-8cbc-d07c7c0c595e', '447ceebf-e83c-4916-8e77-6d4cb9287d1d', '45a45254-6559-4998-ac1f-0d107ae9c60e', '5c39b323-77ea-4333-9fe9-43863ed04374'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:56 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:56 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:56 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.675s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Deleted volume successfully. Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1134fb4a-6d51-49bd-829e-1e161672694f tempest-VolumesSnapshotListTestJSON-183965499 None] Lock "cinder-7d268780-69a9-4231-9a70-c1be4927a3ba-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-742dd737-ae9e-4dca-8d74-98ac8865b9ec-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-742dd737-ae9e-4dca-8d74-98ac8865b9ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:56 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.660s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-quobyte-742dd737-ae9e-4dca-8d74-98ac8865b9ec" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Deleted volume successfully. Jul 07 08:31:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-742dd737-ae9e-4dca-8d74-98ac8865b9ec" acquired by "delete_volume" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d397f5d7-8874-412a-b231-8fb1b216c35a tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-882ef7b0-e6a1-4c16-aaa5-93eb35b2660d-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:57 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0640aa-6efc-4948-9c04-09cd1c6d1c9a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:57 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec Jul 07 08:31:57 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:57 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec" returned: 0 in 0.794s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:57 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec Jul 07 08:31:57 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:58 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-742dd737-ae9e-4dca-8d74-98ac8865b9ec" returned: 0 in 0.651s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-742dd737-ae9e-4dca-8d74-98ac8865b9ec" released by "delete_volume" :: held 1.502s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:31:58 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Created reservations ['55c8e15a-24f0-4f6b-8487-6e743ed45a01', 'd7f346b0-a888-4e65-bac8-30be5b18bb70', 'ae72c8fb-6a4e-437c-a5f8-1ce2f48b863b', 'e0bb353a-da6a-40b3-a3f2-72333b74dffb'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:31:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:31:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:31:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:31:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:31:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:31:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:58 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:31:58 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-c646aba7-106f-454f-b643-f7a703a826a4-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-c646aba7-106f-454f-b643-f7a703a826a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-quobyte-bc205167-9249-4f80-9528-373cd2cbbab1" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-bc205167-9249-4f80-9528-373cd2cbbab1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-quobyte-c646aba7-106f-454f-b643-f7a703a826a4" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-c646aba7-106f-454f-b643-f7a703a826a4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Deleting offline snapshot c646aba7-106f-454f-b643-f7a703a826a4 of volume bc205167-9249-4f80-9528-373cd2cbbab1 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] snapshot_file for this snap is: volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c97d99-fc41-49c2-b422-8db145e7dc82]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:31:59 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 Jul 07 08:31:59 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:31:59 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.742s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:31:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Deleted volume successfully. Jul 07 08:31:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7ba582d3-e07b-4c49-89c3-69f441e4e5cd tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-742dd737-ae9e-4dca-8d74-98ac8865b9ec-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:00 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4" returned: 0 in 0.801s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc205167-9249-4f80-9528-373cd2cbbab1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:32:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ce2143-17be-4c4b-b6da-983961987c75]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:00 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 Jul 07 08:32:00 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:00 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1" returned: 0 in 0.775s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:00 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 Jul 07 08:32:00 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:01 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4" returned: 0 in 0.720s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:01 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4 Jul 07 08:32:01 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:02 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1.c646aba7-106f-454f-b643-f7a703a826a4" returned: 0 in 0.669s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-c646aba7-106f-454f-b643-f7a703a826a4" released by "_delete_snapshot" :: held 3.088s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-bc205167-9249-4f80-9528-373cd2cbbab1" released by "delete_snapshot" :: held 3.119s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:02 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Created reservations ['9b7e017d-acba-426d-a96f-8135eacb4547', '06e01bc0-11e8-4877-9b69-d49950c6f320', 'b20256f2-1d70-4dde-af91-283edcf60f2d', '33815c15-8754-47f2-a8a7-825a2845e4ec'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:02 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Delete snapshot completed successfully. Jul 07 08:32:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1cb3333-a0a1-466d-8143-7bacb8e8f4ba tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-c646aba7-106f-454f-b643-f7a703a826a4-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-bc205167-9249-4f80-9528-373cd2cbbab1-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-bc205167-9249-4f80-9528-373cd2cbbab1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "cinder-quobyte-bc205167-9249-4f80-9528-373cd2cbbab1" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-bc205167-9249-4f80-9528-373cd2cbbab1" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:03 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f9186f-02ee-44c2-b2a9-37c74f86e0d0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:03 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 Jul 07 08:32:03 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:04 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1" returned: 0 in 0.761s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:04 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1 Jul 07 08:32:04 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:32:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:04 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:32:04 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:05 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc205167-9249-4f80-9528-373cd2cbbab1" returned: 0 in 0.755s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-quobyte-bc205167-9249-4f80-9528-373cd2cbbab1" released by "delete_volume" :: held 1.583s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Created reservations ['eda6f400-8ed5-4b4d-8d66-26b553812f10', 'b0781e4a-edb5-443f-9cbb-6cc56e63d94b', 'd6a34311-ee73-4878-9222-a986f5ba720b', '22461467-3d8b-4745-a2dd-6f3e018e4bac'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:05 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:32:05 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:05 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.784s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:32:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:32:06 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.698s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:06 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:32:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Deleted volume successfully. Jul 07 08:32:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d64e1d18-0924-4cf3-8344-f376ad1738f6 tempest-CreateVolumesFromSnapshotTest-155367425 None] Lock "cinder-bc205167-9249-4f80-9528-373cd2cbbab1-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Flow 'volume_create_manager' (b57cc30e-46dd-4ea6-a91b-d523717e6f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42870060-6efd-40c0-a323-c27f8b030554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42870060-6efd-40c0-a323-c27f8b030554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee02e33-eede-48a4-acd1-77d3aa9a0de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b25c86983594eadae051ca5864a364d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:09Z,use_quota=True,user_id='d1fda7d3a0574dce90ae2f5b1f5bd68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc2b7f2-cc78-4e6b-a8cb-da1243541147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc2b7f2-cc78-4e6b-a8cb-da1243541147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1699a533-4940-4ea0-923b-6a30ded25495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1699a533-4940-4ea0-923b-6a30ded25495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee02e33-eede-48a4-acd1-77d3aa9a0de1', 'volume_name': 'volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6cf7f0-7289-42d6-9e50-e2eafc12fdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6cf7f0-7289-42d6-9e50-e2eafc12fdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15869525-2520-42be-b730-1fdacc2ab9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:08 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Volume 3ee02e33-eede-48a4-acd1-77d3aa9a0de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1', 'volume_size': 1} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee02e33-eede-48a4-acd1-77d3aa9a0de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b25c86983594eadae051ca5864a364d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:09Z,use_quota=True,user_id='d1fda7d3a0574dce90ae2f5b1f5bd68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Creating volume 3ee02e33-eede-48a4-acd1-77d3aa9a0de1 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:32:08 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:32:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:08 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 1073741824 Jul 07 08:32:08 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:09 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 1073741824" returned: 0 in 0.901s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:09 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 Jul 07 08:32:09 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:10 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1" returned: 0 in 0.714s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:32:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15869525-2520-42be-b730-1fdacc2ab9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7d868a-ee56-497a-8193-6e7fcaeec00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:10 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Volume volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 (3ee02e33-eede-48a4-acd1-77d3aa9a0de1): created successfully Jul 07 08:32:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7d868a-ee56-497a-8193-6e7fcaeec00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Flow 'volume_create_manager' (b57cc30e-46dd-4ea6-a91b-d523717e6f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5bcbca1c-cf00-4f98-bd13-5dda66a35531 tempest-CinderUnicodeTest-1205801839 None] Created volume successfully. Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Flow 'volume_create_manager' (0968ab08-6f68-47af-ba52-817c30d361d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e91f34-5d65-443e-899e-5a8c8d926d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e91f34-5d65-443e-899e-5a8c8d926d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-662687224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed1f781-d3a8-42a3-9c3b-bb5a89915245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b25c86983594eadae051ca5864a364d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:11Z,use_quota=True,user_id='d1fda7d3a0574dce90ae2f5b1f5bd68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af55b2b7-537d-4f53-86dd-7f873f494c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af55b2b7-537d-4f53-86dd-7f873f494c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0ecb3f-54a7-485e-bb26-4eb6cbc30641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe0ecb3f-54a7-485e-bb26-4eb6cbc30641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed1f781-d3a8-42a3-9c3b-bb5a89915245', 'volume_name': 'volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708c39d6-d1bd-46f3-943e-8d796aef73e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708c39d6-d1bd-46f3-943e-8d796aef73e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b47697-5a64-44b6-97b7-694aac69f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:11 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Volume 4ed1f781-d3a8-42a3-9c3b-bb5a89915245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245', 'volume_size': 1} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-662687224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed1f781-d3a8-42a3-9c3b-bb5a89915245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b25c86983594eadae051ca5864a364d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:11Z,use_quota=True,user_id='d1fda7d3a0574dce90ae2f5b1f5bd68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Creating volume 4ed1f781-d3a8-42a3-9c3b-bb5a89915245 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:32:11 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:32:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:11 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 1073741824 Jul 07 08:32:11 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:12 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 1073741824" returned: 0 in 0.829s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:12 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 Jul 07 08:32:12 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:13 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" returned: 0 in 0.703s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b47697-5a64-44b6-97b7-694aac69f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbe4892-f035-4ac8-814f-4af6c79150e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:13 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Volume volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 (4ed1f781-d3a8-42a3-9c3b-bb5a89915245): created successfully Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbe4892-f035-4ac8-814f-4af6c79150e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Flow 'volume_create_manager' (0968ab08-6f68-47af-ba52-817c30d361d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-285ec97f-95f7-4346-916f-ec909d8673a8 tempest-CinderUnicodeTest-1205801839 None] Created volume successfully. Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Creating offline snapshot 63997f5b-a2e3-4066-a233-92de52d09f2b of volume 4ed1f781-d3a8-42a3-9c3b-bb5a89915245 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5643fe53-d3c4-4bb1-b0f1-7f7595058ca2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:13 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 Jul 07 08:32:13 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:14 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" returned: 0 in 0.843s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:14 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b 1G Jul 07 08:32:14 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:15 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b 1G" returned: 0 in 1.067s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:15 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b Jul 07 08:32:15 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:16 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b" returned: 0 in 0.710s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:16 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b is being set with open permissions: ugo+rw Jul 07 08:32:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:16 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b Jul 07 08:32:16 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:17 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b" returned: 0 in 0.614s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:17 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.info Jul 07 08:32:17 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:17 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.info" returned: 0 in 0.722s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:17 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.info is being set with open permissions: ugo+rw Jul 07 08:32:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:17 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.info Jul 07 08:32:17 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:18 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.info" returned: 0 in 0.683s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.738s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:18 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c64d1b95-f01e-4b84-9368-c8fb449e3f4a tempest-CinderUnicodeTest-1205801839 None] Create snapshot completed successfully Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "cinder-63997f5b-a2e3-4066-a233-92de52d09f2b-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-63997f5b-a2e3-4066-a233-92de52d09f2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "cinder-quobyte-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-quobyte-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "cinder-quobyte-63997f5b-a2e3-4066-a233-92de52d09f2b" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-quobyte-63997f5b-a2e3-4066-a233-92de52d09f2b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Deleting offline snapshot 63997f5b-a2e3-4066-a233-92de52d09f2b of volume 4ed1f781-d3a8-42a3-9c3b-bb5a89915245 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] snapshot_file for this snap is: volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a3db34-23c0-4eab-a477-78d591a30e13]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:19 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b Jul 07 08:32:19 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:19 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b" returned: 0 in 0.756s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74ba582-9fde-42c6-bb99-2f699654a1de]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:20 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 Jul 07 08:32:20 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:20 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" returned: 0 in 0.781s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:20 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b Jul 07 08:32:20 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:21 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b" returned: 0 in 0.774s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:21 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b Jul 07 08:32:21 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Flow 'volume_create_manager' (5f4422d7-9712-4866-b258-bded31280baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685ce7c2-eeae-4ab6-b0e2-ca455a6c2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685ce7c2-eeae-4ab6-b0e2-ca455a6c2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1605373122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acecc69-4487-45e9-b9ff-98b3ffe23c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7489d1c6aa4e09ae911bf96bd2b17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:22Z,use_quota=True,user_id='c4f9ff7f6e774446a26a44052bbe87d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf884bc3-ab97-40e4-9bb9-5bed4f6c2a55),volume_type_id=bf884bc3-ab97-40e4-9bb9-5bed4f6c2a55)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835960b4-c499-4da2-abfe-8db12565052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835960b4-c499-4da2-abfe-8db12565052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e9a9bd-cfdb-476f-8b40-12bc078e03ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e9a9bd-cfdb-476f-8b40-12bc078e03ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4acecc69-4487-45e9-b9ff-98b3ffe23c01', 'volume_name': 'volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6962d0fd-2efc-47cd-9ac7-851f3d08c12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6962d0fd-2efc-47cd-9ac7-851f3d08c12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdef73f-60d4-4ca7-a87b-9c380ff225b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:21 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Volume 4acecc69-4487-45e9-b9ff-98b3ffe23c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01', 'volume_size': 1} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1605373122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acecc69-4487-45e9-b9ff-98b3ffe23c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7489d1c6aa4e09ae911bf96bd2b17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:22Z,use_quota=True,user_id='c4f9ff7f6e774446a26a44052bbe87d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf884bc3-ab97-40e4-9bb9-5bed4f6c2a55),volume_type_id=bf884bc3-ab97-40e4-9bb9-5bed4f6c2a55)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Creating volume 4acecc69-4487-45e9-b9ff-98b3ffe23c01 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:32:21 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:32:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:21 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 1073741824 Jul 07 08:32:21 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Flow 'volume_create_manager' (10f47717-c9d5-448a-b509-74d2cb53e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59847718-e845-456b-b424-56f4bb8467ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59847718-e845-456b-b424-56f4bb8467ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1457030055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7489d1c6aa4e09ae911bf96bd2b17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:22Z,use_quota=True,user_id='c4f9ff7f6e774446a26a44052bbe87d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(593a70e4-e650-4af5-b3b2-2ea7a00830a7),volume_type_id=593a70e4-e650-4af5-b3b2-2ea7a00830a7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f519e342-bf07-4758-b3f7-39dc690fa9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f519e342-bf07-4758-b3f7-39dc690fa9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061a7baa-6593-4363-89ef-4690025339d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061a7baa-6593-4363-89ef-4690025339d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039', 'volume_name': 'volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7423c69-bd1b-470c-a146-1c2846912394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7423c69-bd1b-470c-a146-1c2846912394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5562d1b4-d357-43c0-b47c-f0d293a1c4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:22 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Volume b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039', 'volume_size': 1} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:22 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245.63997f5b-a2e3-4066-a233-92de52d09f2b" returned: 0 in 0.898s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-quobyte-63997f5b-a2e3-4066-a233-92de52d09f2b" released by "_delete_snapshot" :: held 3.329s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-quobyte-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" released by "delete_snapshot" :: held 3.355s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Created reservations ['df7f4e26-caa9-4dfd-9af1-f074d2677732', 'ec8e512a-6bad-44e9-8ece-f301b58810df', 'a5369315-5250-481f-90b6-7dc355a692a5', '52e54fa0-bf98-4a7f-a9b3-9bdfd1ec7cd0'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Delete snapshot completed successfully. Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-15f49a5e-fcd4-4219-9ef9-45ca702d29a5 tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-63997f5b-a2e3-4066-a233-92de52d09f2b-delete_snapshot" released by "delete_snapshot" :: held 3.555s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:22 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 1073741824" returned: 0 in 0.961s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:22 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 Jul 07 08:32:22 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Flow 'volume_create_manager' (ceb55dec-f5d9-452b-a349-e8375be976b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c316760-5e31-473b-be7b-2b51d29f5c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c316760-5e31-473b-be7b-2b51d29f5c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-365487649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49783464-5b73-40c1-b57f-cf896cd743cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7489d1c6aa4e09ae911bf96bd2b17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:23Z,use_quota=True,user_id='c4f9ff7f6e774446a26a44052bbe87d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3efbe5ae-2aa6-401e-9102-94f4f7c76449),volume_type_id=3efbe5ae-2aa6-401e-9102-94f4f7c76449)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fe36c7-0304-443c-add0-f8ec2d0131d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fe36c7-0304-443c-add0-f8ec2d0131d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57de7ecb-6d2e-41c1-b414-4504d752ca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.image.glance [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Creating Keystone auth plugin from conf {{(pid=87179) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57de7ecb-6d2e-41c1-b414-4504d752ca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49783464-5b73-40c1-b57f-cf896cd743cb', 'volume_name': 'volume-49783464-5b73-40c1-b57f-cf896cd743cb', 'volume_size': 1, 'image_id': '5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1725175284', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e7489d1c6aa4e09ae911bf96bd2b17b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'created_at': datetime.datetime(2026, 7, 7, 6, 32, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 32, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d08e6d8-732c-49d0-bffa-b455817c7ad8/file', 'properties': {}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ee6124-0a74-4b83-829e-8fc44972ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ee6124-0a74-4b83-829e-8fc44972ac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66f1cb5-1cc8-474b-933e-33f9f14751a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:23 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Volume 49783464-5b73-40c1-b57f-cf896cd743cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49783464-5b73-40c1-b57f-cf896cd743cb', 'volume_size': 1, 'image_id': '5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1725175284', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e7489d1c6aa4e09ae911bf96bd2b17b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'created_at': datetime.datetime(2026, 7, 7, 6, 32, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 32, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d08e6d8-732c-49d0-bffa-b455817c7ad8/file', 'properties': {}}, 'image_service': } Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Trying to clone 49783464-5b73-40c1-b57f-cf896cd743cb from image 5d08e6d8-732c-49d0-bffa-b455817c7ad8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'metadata': {}}]). {{(pid=87179) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "cinder-4ed1f781-d3a8-42a3-9c3b-bb5a89915245-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-4ed1f781-d3a8-42a3-9c3b-bb5a89915245-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "cinder-quobyte-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-quobyte-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c5fce6-7922-408a-8f7a-ae87773a9a38]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:23 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01" returned: 0 in 0.866s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.412s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1457030055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7489d1c6aa4e09ae911bf96bd2b17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:22Z,use_quota=True,user_id='c4f9ff7f6e774446a26a44052bbe87d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(593a70e4-e650-4af5-b3b2-2ea7a00830a7),volume_type_id=593a70e4-e650-4af5-b3b2-2ea7a00830a7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Creating volume b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:32:23 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:23 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 Jul 07 08:32:23 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:23 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 1073741824 Jul 07 08:32:23 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdef73f-60d4-4ca7-a87b-9c380ff225b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c82db6b-3d02-4ba8-881d-072b9d36e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:23 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Volume volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 (4acecc69-4487-45e9-b9ff-98b3ffe23c01): created successfully Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c82db6b-3d02-4ba8-881d-072b9d36e702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Flow 'volume_create_manager' (5f4422d7-9712-4866-b258-bded31280baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:23 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-0c96778d-f0c4-4ad0-94c3-6c95690075b3 tempest-TestInstancesWithCinderVolumes-1389902248 None] Created volume successfully. Jul 07 08:32:24 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" returned: 0 in 0.851s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:24 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245 Jul 07 08:32:24 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:24 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 1073741824" returned: 0 in 0.854s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:24 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 Jul 07 08:32:24 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:25 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" returned: 0 in 0.717s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-quobyte-4ed1f781-d3a8-42a3-9c3b-bb5a89915245" released by "delete_volume" :: held 1.654s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Created reservations ['7e9bd5a5-cd20-43f3-adde-eb9e9daa20b1', '34e9c19d-8d17-4280-99d1-4a30ef58a3ad', '3e5096c1-06c9-413e-af0a-63f4d0ce1440', '26d40091-eb07-4773-a748-ce5fe77852a6'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:25 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039" returned: 0 in 0.657s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5562d1b4-d357-43c0-b47c-f0d293a1c4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef10d4ea-b690-4ae6-bbd7-383690bd7088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:25 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Volume volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 (b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039): created successfully Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef10d4ea-b690-4ae6-bbd7-383690bd7088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Flow 'volume_create_manager' (10f47717-c9d5-448a-b509-74d2cb53e852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-102f5d2d-970c-4171-a28a-a71d25b1bb82 tempest-TestInstancesWithCinderVolumes-1389902248 None] Created volume successfully. Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:25 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:32:25 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "cinder-3ee02e33-eede-48a4-acd1-77d3aa9a0de1-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-3ee02e33-eede-48a4-acd1-77d3aa9a0de1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "cinder-quobyte-3ee02e33-eede-48a4-acd1-77d3aa9a0de1" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-quobyte-3ee02e33-eede-48a4-acd1-77d3aa9a0de1" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[583a5381-3e26-4049-a706-fb49c41a93aa]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:25 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 Jul 07 08:32:25 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:26 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.665s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:26 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:32:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Deleted volume successfully. Jul 07 08:32:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-30fba35e-255b-4d22-abeb-3c90a61b9ded tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-4ed1f781-d3a8-42a3-9c3b-bb5a89915245-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:26 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1" returned: 0 in 0.855s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:26 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1 Jul 07 08:32:26 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:26 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD, size 20.69 MB, duration 3.61 sec {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:32:26 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Image download 20.69 MB at 5.74 MB/s Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d544e0a5-dabe-4ae1-ba50-4731f3d15e76]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:27 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD Jul 07 08:32:27 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:27 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3ee02e33-eede-48a4-acd1-77d3aa9a0de1" returned: 0 in 0.700s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-quobyte-3ee02e33-eede-48a4-acd1-77d3aa9a0de1" released by "delete_volume" :: held 1.619s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Created reservations ['36bf5218-207b-456e-b023-77d015426c3a', 'b8dd15ba-70af-410f-a0da-71e645fb1109', 'dfa306f9-4e06-4485-a820-cebf549d0e3e', '6e701738-a165-4454-869c-df1cc911c20a'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:27 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:32:27 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:27 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD" returned: 0 in 0.728s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Temporary image 5d08e6d8-732c-49d0-bffa-b455817c7ad8 is fetched for user c4f9ff7f6e774446a26a44052bbe87d9. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa048a4-92a9-44af-afe4-f11f7a1018fe]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:27 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD Jul 07 08:32:27 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:28 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:32:28 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Deleted volume successfully. Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5480001e-577b-4ffc-a931-1c22232f0fdb tempest-CinderUnicodeTest-1205801839 None] Lock "cinder-3ee02e33-eede-48a4-acd1-77d3aa9a0de1-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:32:28 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-365487649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49783464-5b73-40c1-b57f-cf896cd743cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e7489d1c6aa4e09ae911bf96bd2b17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:32:23Z,use_quota=True,user_id='c4f9ff7f6e774446a26a44052bbe87d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3efbe5ae-2aa6-401e-9102-94f4f7c76449),volume_type_id=3efbe5ae-2aa6-401e-9102-94f4f7c76449)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Creating volume 49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:32:28 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:32:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:28 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb 1073741824 Jul 07 08:32:28 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:29 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb 1073741824" returned: 0 in 0.919s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:29 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb Jul 07 08:32:29 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:30 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb" returned: 0 in 0.692s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:32:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:30 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Attempting download of 5d08e6d8-732c-49d0-bffa-b455817c7ad8 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'metadata': {}}])) to volume 49783464-5b73-40c1-b57f-cf896cd743cb. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:32:30 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9c9657-056c-4cd9-8348-6e630383c4fa]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d08e6d8-732c-49d0-bffa-b455817c7ad8_3ylfjow1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:30 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d08e6d8-732c-49d0-bffa-b455817c7ad8_3ylfjow1 Jul 07 08:32:30 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:31 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d08e6d8-732c-49d0-bffa-b455817c7ad8_3ylfjow1" returned: 0 in 0.731s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d08e6d8-732c-49d0-bffa-b455817c7ad8_3ylfjow1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:31 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d08e6d8-732c-49d0-bffa-b455817c7ad8_3ylfjow1 Jul 07 08:32:31 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:31 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d08e6d8-732c-49d0-bffa-b455817c7ad8_3ylfjow1" returned: 1 in 0.850s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d08e6d8-732c-49d0-bffa-b455817c7ad8_3ylfjow1' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:32:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d18600-cf1c-40ba-ae00-0ac0e8966919]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:32 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD Jul 07 08:32:32 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:32 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:32 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] 5d08e6d8-732c-49d0-bffa-b455817c7ad8 was qcow2, converting to raw {{(pid=87179) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:32:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:32 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb Jul 07 08:32:32 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:34 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb" returned: 0 in 2.081s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:34 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d08e6d8-732c-49d0-bffa-b455817c7ad8_vqrbrb5edevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:32:34 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Converted 112.00 MB image at 53.78 MB/s Jul 07 08:32:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:34 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb 1G Jul 07 08:32:34 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:35 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb 1G" returned: 0 in 0.708s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6e0c6c-3935-458f-83a3-f2768ab126d4]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:35 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb Jul 07 08:32:35 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:36 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb" returned: 0 in 0.797s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:36 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb Jul 07 08:32:36 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:37 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb" returned: 1 in 0.726s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Downloaded image 5d08e6d8-732c-49d0-bffa-b455817c7ad8 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'metadata': {}}])) to volume 49783464-5b73-40c1-b57f-cf896cd743cb successfully. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Temporary image 5d08e6d8-732c-49d0-bffa-b455817c7ad8 for user c4f9ff7f6e774446a26a44052bbe87d9 is deleted. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Marking volume 49783464-5b73-40c1-b57f-cf896cd743cb as bootable. {{(pid=87179) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Copying metadata from image 5d08e6d8-732c-49d0-bffa-b455817c7ad8 to 49783464-5b73-40c1-b57f-cf896cd743cb. {{(pid=87179) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Creating volume glance metadata for volume 49783464-5b73-40c1-b57f-cf896cd743cb backed by image 5d08e6d8-732c-49d0-bffa-b455817c7ad8 with: {'image_id': '5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'image_name': 'tempest-scenario-img--1725175284', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87179) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66f1cb5-1cc8-474b-933e-33f9f14751a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49783464-5b73-40c1-b57f-cf896cd743cb', 'volume_size': 1, 'image_id': '5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1725175284', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2e7489d1c6aa4e09ae911bf96bd2b17b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d08e6d8-732c-49d0-bffa-b455817c7ad8', 'created_at': datetime.datetime(2026, 7, 7, 6, 32, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 32, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d08e6d8-732c-49d0-bffa-b455817c7ad8/file', 'properties': {}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4d0135-b317-4a11-b0ec-507a81348781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:32:37 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Volume volume-49783464-5b73-40c1-b57f-cf896cd743cb (49783464-5b73-40c1-b57f-cf896cd743cb): created successfully Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4d0135-b317-4a11-b0ec-507a81348781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:32:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Flow 'volume_create_manager' (ceb55dec-f5d9-452b-a349-e8375be976b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:32:37 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-58b131b3-f7d8-4e41-8759-8e4c0231918b tempest-TestInstancesWithCinderVolumes-1389902248 None] Created volume successfully. Jul 07 08:32:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:32:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:32:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a07fc6-9989-46c0-b4b7-fde745fbf613]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:32:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:45 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb Jul 07 08:32:45 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:45 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb" returned: 0 in 0.817s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:32:46 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb Jul 07 08:32:46 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:32:46 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jul 07 08:32:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb" returned: 1 in 0.729s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:32:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:32:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.589s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:32:46 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=83,cinder:UPDATE=110,cinder:DELETE=12,cinder:INSERT=32 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:32:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-49783464-5b73-40c1-b57f-cf896cd743cb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ded98f6b-132d-4b4f-aeee-2c2dd01ce9c4', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:32:46 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-26f9b93c-422c-48dd-b0ca-2eb7a19adbba req-cd7b447f-497a-479f-890e-62dcbc883124 tempest-TestInstancesWithCinderVolumes-1389902248 None] attachment_update completed successfully. Jul 07 08:32:56 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=1,cinder:SELECT=3 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:32:56 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=69,cinder:UPDATE=88,cinder:INSERT=27,cinder:DELETE=3 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:33:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:33:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:33:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:33:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:04 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:33:04 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:05 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.701s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:33:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:33:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:33:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:33:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-2d933597-4c36-4e43-ba94-23d307779cd1 req-c9221896-25d5-47e1-bb3f-9479aa252b07 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-2d933597-4c36-4e43-ba94-23d307779cd1 req-c9221896-25d5-47e1-bb3f-9479aa252b07 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ebdaef-f4cc-407e-b46b-db9e4d8d5630]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-2d933597-4c36-4e43-ba94-23d307779cd1 req-c9221896-25d5-47e1-bb3f-9479aa252b07 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:23 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 Jul 07 08:33:23 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:23 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-2d933597-4c36-4e43-ba94-23d307779cd1 req-c9221896-25d5-47e1-bb3f-9479aa252b07 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01" returned: 0 in 0.744s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-2d933597-4c36-4e43-ba94-23d307779cd1 req-c9221896-25d5-47e1-bb3f-9479aa252b07 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-2d933597-4c36-4e43-ba94-23d307779cd1 req-c9221896-25d5-47e1-bb3f-9479aa252b07 tempest-TestInstancesWithCinderVolumes-1389902248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6abdfa3-938f-456b-b2d6-3123580a9aa3', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:33:23 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-2d933597-4c36-4e43-ba94-23d307779cd1 req-c9221896-25d5-47e1-bb3f-9479aa252b07 tempest-TestInstancesWithCinderVolumes-1389902248 None] attachment_update completed successfully. Jul 07 08:33:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-4d3ed914-9ac8-4f1f-9ef6-22d4d1c49d65 req-88b8744a-b54d-4ac2-8565-18fac4f0418d tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-4d3ed914-9ac8-4f1f-9ef6-22d4d1c49d65 req-88b8744a-b54d-4ac2-8565-18fac4f0418d tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f42eae6-060b-4c2d-b777-e3385019537c]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-4d3ed914-9ac8-4f1f-9ef6-22d4d1c49d65 req-88b8744a-b54d-4ac2-8565-18fac4f0418d tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:31 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 Jul 07 08:33:31 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:32 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-4d3ed914-9ac8-4f1f-9ef6-22d4d1c49d65 req-88b8744a-b54d-4ac2-8565-18fac4f0418d tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039" returned: 0 in 0.763s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-4d3ed914-9ac8-4f1f-9ef6-22d4d1c49d65 req-88b8744a-b54d-4ac2-8565-18fac4f0418d tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-4d3ed914-9ac8-4f1f-9ef6-22d4d1c49d65 req-88b8744a-b54d-4ac2-8565-18fac4f0418d tempest-TestInstancesWithCinderVolumes-1389902248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44f008bd-e6e8-4380-8c66-be63904c3ca1', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:33:32 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-4d3ed914-9ac8-4f1f-9ef6-22d4d1c49d65 req-88b8744a-b54d-4ac2-8565-18fac4f0418d tempest-TestInstancesWithCinderVolumes-1389902248 None] attachment_update completed successfully. Jul 07 08:33:40 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-277ba385-b46c-4087-b202-6cfb91a9cdf1 req-5b0d52ed-6fb6-4d45-823f-771056b0be76 tempest-TestInstancesWithCinderVolumes-1389902248 None] Terminate volume connection completed successfully. Jul 07 08:33:40 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-277ba385-b46c-4087-b202-6cfb91a9cdf1 req-5b0d52ed-6fb6-4d45-823f-771056b0be76 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deleting attachment a6abdfa3-938f-456b-b2d6-3123580a9aa3. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:33:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "cinder-4acecc69-4487-45e9-b9ff-98b3ffe23c01-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-4acecc69-4487-45e9-b9ff-98b3ffe23c01-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "cinder-quobyte-4acecc69-4487-45e9-b9ff-98b3ffe23c01" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-quobyte-4acecc69-4487-45e9-b9ff-98b3ffe23c01" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:42 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5366e-ad20-4036-abe3-b1401af87640]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:42 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 Jul 07 08:33:42 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:43 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01" returned: 0 in 0.794s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:43 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01 Jul 07 08:33:43 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:44 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4acecc69-4487-45e9-b9ff-98b3ffe23c01" returned: 0 in 0.628s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-quobyte-4acecc69-4487-45e9-b9ff-98b3ffe23c01" released by "delete_volume" :: held 1.463s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:33:44 devstack cinder-volume[87179]: WARNING cinder.quota [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-507956255-1932361282 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-507956255-1932361282, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:33:44 devstack cinder-volume[87179]: WARNING cinder.quota [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-507956255-1932361282 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-507956255-1932361282, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Created reservations ['fcda85a1-c1e0-428d-9cea-e0edc2ecce41', 'b7c16b04-c283-4746-a96a-445faf84d4d3', '6dcb32b8-178e-4863-9bce-fe90fa0b047b', 'c4c85096-3fd8-4c0d-9e24-2dff35879169'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:44 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:33:44 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:44 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.635s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:44 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:33:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deleted volume successfully. Jul 07 08:33:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f9df78eb-1ca3-4206-9711-7bc373bb1fa5 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-4acecc69-4487-45e9-b9ff-98b3ffe23c01-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:33:46 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-8c9c0e0c-a50f-4f5e-bc94-9d8d02d1f9cc req-9df6b8f9-c3b8-4fff-b68e-3d6baefcdcaf tempest-TestInstancesWithCinderVolumes-1389902248 None] Terminate volume connection completed successfully. Jul 07 08:33:46 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-8c9c0e0c-a50f-4f5e-bc94-9d8d02d1f9cc req-9df6b8f9-c3b8-4fff-b68e-3d6baefcdcaf tempest-TestInstancesWithCinderVolumes-1389902248 None] Deleting attachment 44f008bd-e6e8-4380-8c66-be63904c3ca1. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:33:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "cinder-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "cinder-quobyte-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-quobyte-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:49 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad149eb-7288-4197-af4a-a77fad67450d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:49 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 Jul 07 08:33:49 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:49 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039" returned: 0 in 0.774s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:49 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039 Jul 07 08:33:49 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:50 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039" returned: 0 in 0.660s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-quobyte-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039" released by "delete_volume" :: held 1.477s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:33:50 devstack cinder-volume[87179]: WARNING cinder.quota [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-992266980-321429635 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-992266980-321429635, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:33:50 devstack cinder-volume[87179]: WARNING cinder.quota [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-992266980-321429635 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-992266980-321429635, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:33:50 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Created reservations ['50d8aace-9389-41be-a2f5-8e3383eb6c8e', 'f872d5b7-c353-41a8-b410-cc8b5f884ccc', 'd1ac2816-5a30-4146-81d2-a9872d4c8c4f', 'b2f2ca9e-664c-411f-b1e3-d3fef512fdd5'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:33:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:33:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:33:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:33:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:33:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:33:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:50 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:33:50 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:51 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.702s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:51 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:33:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deleted volume successfully. Jul 07 08:33:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9d3bcc50-5d5c-466e-9f9f-3b2db9d638a2 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-b2f95ee9-54b6-4fc2-8b62-c8ef00bfa039-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:33:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-5b70905c-c278-4ed2-b6f1-f6ecdbbabb96 req-ef5e894c-6506-415d-9b82-a271c7a9aec7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Terminate volume connection completed successfully. Jul 07 08:33:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-5b70905c-c278-4ed2-b6f1-f6ecdbbabb96 req-ef5e894c-6506-415d-9b82-a271c7a9aec7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deleting attachment ded98f6b-132d-4b4f-aeee-2c2dd01ce9c4. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:33:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "cinder-49783464-5b73-40c1-b57f-cf896cd743cb-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-49783464-5b73-40c1-b57f-cf896cd743cb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "cinder-quobyte-49783464-5b73-40c1-b57f-cf896cd743cb" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:33:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-quobyte-49783464-5b73-40c1-b57f-cf896cd743cb" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:33:58 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[348d0a88-f2bf-4ca8-8059-ebf643273207]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:33:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:58 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb Jul 07 08:33:58 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:33:59 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jul 07 08:33:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb" returned: 0 in 0.713s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:33:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:33:59 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb Jul 07 08:33:59 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:00 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb" returned: 1 in 0.708s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:00 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb Jul 07 08:34:00 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:00 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-49783464-5b73-40c1-b57f-cf896cd743cb" returned: 0 in 0.601s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-quobyte-49783464-5b73-40c1-b57f-cf896cd743cb" released by "delete_volume" :: held 2.085s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:00 devstack cinder-volume[87179]: WARNING cinder.quota [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1737650898-1876028407 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1737650898-1876028407, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:34:00 devstack cinder-volume[87179]: WARNING cinder.quota [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1737650898-1876028407 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1737650898-1876028407, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Created reservations ['b0086962-6410-4c07-8f21-5d7b92a66e78', 'cd18608e-f87f-4873-8021-b4b4bab2ca5e', 'b9181f9c-465f-43e4-8f30-c089dc5823f6', '12615620-0d83-4dec-a510-8d5b0877773c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:00 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:34:00 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:01 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.599s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:01 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:01 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Deleted volume successfully. Jul 07 08:34:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8b3021de-be57-4b3d-911a-0ab687c9f4a7 tempest-TestInstancesWithCinderVolumes-1389902248 None] Lock "cinder-49783464-5b73-40c1-b57f-cf896cd743cb-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:34:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:34:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:04 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:34:04 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:05 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.749s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:34:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:34:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:34:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:34:10 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=26,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:34:11 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=33,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Flow 'volume_create_manager' (abe7437a-719a-4c3c-ab66-ffe08dbd8637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de942a8-f0fe-4865-b31b-b269cf3b8ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de942a8-f0fe-4865-b31b-b269cf3b8ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-208658127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320743f2-c8d4-429a-ae48-7ba49f28625c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2f4bc8ce2b04944bfac6d0cb506f0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:30Z,use_quota=True,user_id='7d58cb3c9beb4312879e44449a6dadf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba55a4c-c9a0-4187-b926-17b6b84fac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba55a4c-c9a0-4187-b926-17b6b84fac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6294f5b5-4393-4f5f-a9f1-3c2130077f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6294f5b5-4393-4f5f-a9f1-3c2130077f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320743f2-c8d4-429a-ae48-7ba49f28625c', 'volume_name': 'volume-320743f2-c8d4-429a-ae48-7ba49f28625c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe6b189-be12-45b2-9156-0e4980c6e023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe6b189-be12-45b2-9156-0e4980c6e023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7f13b3-e385-4b60-a386-87b129cd01ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:29 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Volume 320743f2-c8d4-429a-ae48-7ba49f28625c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320743f2-c8d4-429a-ae48-7ba49f28625c', 'volume_size': 1} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-208658127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320743f2-c8d4-429a-ae48-7ba49f28625c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2f4bc8ce2b04944bfac6d0cb506f0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:34:30Z,use_quota=True,user_id='7d58cb3c9beb4312879e44449a6dadf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Creating volume 320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:34:29 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:34:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:29 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c 1073741824 Jul 07 08:34:29 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:30 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c 1073741824" returned: 0 in 0.843s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:34:30 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c Jul 07 08:34:30 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:34:31 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 07 08:34:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c" returned: 0 in 0.638s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:34:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:34:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:34:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb7f13b3-e385-4b60-a386-87b129cd01ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320743f2-c8d4-429a-ae48-7ba49f28625c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff4df9a-aa10-40f5-a208-022e71d75da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:34:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Volume volume-320743f2-c8d4-429a-ae48-7ba49f28625c (320743f2-c8d4-429a-ae48-7ba49f28625c): created successfully Jul 07 08:34:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff4df9a-aa10-40f5-a208-022e71d75da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:34:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Flow 'volume_create_manager' (abe7437a-719a-4c3c-ab66-ffe08dbd8637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:34:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2f5b4ca4-230c-4384-abae-35dce49b6f2d tempest-TestStampPattern-199976689 None] Created volume successfully. Jul 07 08:34:41 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:34:41 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:35:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:35:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:04 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:35:04 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:05 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.613s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:35:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:35:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:35:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:35:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-d7cd9173-b8f2-40c0-a0b7-73594200cdfe req-ef2f0ee1-b435-4d4d-bdd1-5104742ca57a tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-d7cd9173-b8f2-40c0-a0b7-73594200cdfe req-ef2f0ee1-b435-4d4d-bdd1-5104742ca57a tempest-TestStampPattern-199976689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:09 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6403ef8b-fc9c-42dd-bb99-ab68a5b49ac4]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-d7cd9173-b8f2-40c0-a0b7-73594200cdfe req-ef2f0ee1-b435-4d4d-bdd1-5104742ca57a tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:09 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c Jul 07 08:35:09 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:10 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-d7cd9173-b8f2-40c0-a0b7-73594200cdfe req-ef2f0ee1-b435-4d4d-bdd1-5104742ca57a tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c" returned: 0 in 0.729s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-d7cd9173-b8f2-40c0-a0b7-73594200cdfe req-ef2f0ee1-b435-4d4d-bdd1-5104742ca57a tempest-TestStampPattern-199976689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.744s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-d7cd9173-b8f2-40c0-a0b7-73594200cdfe req-ef2f0ee1-b435-4d4d-bdd1-5104742ca57a tempest-TestStampPattern-199976689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-320743f2-c8d4-429a-ae48-7ba49f28625c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16f7cfe9-7d35-4e6d-9a36-00729e121d5c', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:35:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-d7cd9173-b8f2-40c0-a0b7-73594200cdfe req-ef2f0ee1-b435-4d4d-bdd1-5104742ca57a tempest-TestStampPattern-199976689 None] attachment_update completed successfully. Jul 07 08:35:18 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-93208919-dbed-4c1f-81a5-0fb095a45ece req-3f8ea59d-029d-4cce-b119-394fd0e2fb82 tempest-TestStampPattern-199976689 None] Terminate volume connection completed successfully. Jul 07 08:35:18 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-93208919-dbed-4c1f-81a5-0fb095a45ece req-3f8ea59d-029d-4cce-b119-394fd0e2fb82 tempest-TestStampPattern-199976689 None] Deleting attachment 16f7cfe9-7d35-4e6d-9a36-00729e121d5c. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:35:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:20 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Creating offline snapshot f3646d2a-cece-4fb5-831c-034170f95d7a of volume 320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:35:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee65b69-9eea-47b0-8e7e-04ad1dd9542b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:20 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c Jul 07 08:35:20 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:21 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c" returned: 0 in 0.790s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:21 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a 1G Jul 07 08:35:21 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:21 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a 1G" returned: 0 in 0.753s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320743f2-c8d4-429a-ae48-7ba49f28625c -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:21 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320743f2-c8d4-429a-ae48-7ba49f28625c -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a Jul 07 08:35:21 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:22 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320743f2-c8d4-429a-ae48-7ba49f28625c -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a" returned: 0 in 0.688s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:22 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a is being set with open permissions: ugo+rw Jul 07 08:35:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:22 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a Jul 07 08:35:22 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:23 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a" returned: 0 in 0.610s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:23 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.info Jul 07 08:35:23 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:23 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.info" returned: 0 in 0.613s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:23 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.info is being set with open permissions: ugo+rw Jul 07 08:35:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:23 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.info Jul 07 08:35:23 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:24 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.info" returned: 0 in 0.601s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.135s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-84bf4cec-20a7-4765-a9aa-02df78b9a062 tempest-TestStampPattern-199976689 None] Create snapshot completed successfully Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Flow 'volume_create_manager' (a8563e04-572c-443d-b367-e3013ab127c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3572bbe3-784f-4077-a626-88fed4799c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3572bbe3-784f-4077-a626-88fed4799c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1122273578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2f4bc8ce2b04944bfac6d0cb506f0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3646d2a-cece-4fb5-831c-034170f95d7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:35:35Z,use_quota=True,user_id='7d58cb3c9beb4312879e44449a6dadf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb158c56-c9b1-4dd4-acc1-c864baa7ec19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb158c56-c9b1-4dd4-acc1-c864baa7ec19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfb3e13-f7a6-4b00-bbe4-e96382c1b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfb3e13-f7a6-4b00-bbe4-e96382c1b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec', 'volume_name': 'volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec', 'volume_size': 1, 'snapshot_id': 'f3646d2a-cece-4fb5-831c-034170f95d7a'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14e2f7a-0e09-40cc-bbc0-2754d87db67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14e2f7a-0e09-40cc-bbc0-2754d87db67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac7dec9-8901-406d-85b7-c0212b493936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Volume e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec', 'volume_size': 1, 'snapshot_id': 'f3646d2a-cece-4fb5-831c-034170f95d7a'} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Acquiring lock "cinder-quobyte-f3646d2a-cece-4fb5-831c-034170f95d7a-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" by "_create_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-f3646d2a-cece-4fb5-831c-034170f95d7a-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Creating volume e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec from snapshot f3646d2a-cece-4fb5-831c-034170f95d7a {{(pid=87179) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Acquiring lock "cinder-quobyte-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] snapshot: f3646d2a-cece-4fb5-831c-034170f95d7a, volume: e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2634e6-2298-434b-9224-2b742ea9df8d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:35 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a Jul 07 08:35:35 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:36 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a" returned: 0 in 0.780s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320743f2-c8d4-429a-ae48-7ba49f28625c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:35:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:35:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:35:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c38db53-87d2-4fc5-a54b-c5f9cb7db5e2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:36 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c Jul 07 08:35:36 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:36 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c" returned: 0 in 0.767s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:36 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:35:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:36 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec Jul 07 08:35:36 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:41 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" returned: 0 in 4.645s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:41 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e05aef-7d28-4e1a-9595-4e8ed23787f1]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:35:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:41 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c Jul 07 08:35:41 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:42 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c" returned: 0 in 1.022s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:42 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:35:42 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Converted 1024.00 MB image at 220.40 MB/s Jul 07 08:35:42 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec is being set with open permissions: ugo+rw Jul 07 08:35:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:35:42 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec Jul 07 08:35:42 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:35:43 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 07 08:35:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" returned: 0 in 0.740s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:35:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" released by "_copy_volume_from_snapshot" :: held 8.058s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-f3646d2a-cece-4fb5-831c-034170f95d7a-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" released by "_create_volume_from_snapshot" :: held 8.096s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:35:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.112s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:35:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac7dec9-8901-406d-85b7-c0212b493936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec', 'volume_size': 1, 'snapshot_id': 'f3646d2a-cece-4fb5-831c-034170f95d7a'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08908080-fe17-4e97-b063-631d6f2c89ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:35:43 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Volume volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec (e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec): created successfully Jul 07 08:35:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08908080-fe17-4e97-b063-631d6f2c89ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:35:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Flow 'volume_create_manager' (a8563e04-572c-443d-b367-e3013ab127c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:35:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-24c4f979-e16a-4098-9955-e52ced84a932 tempest-TestStampPattern-199976689 None] Created volume successfully. Jul 07 08:35:53 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:35:53 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:36:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:36:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:04 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:36:04 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:05 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.637s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:36:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:36:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:36:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-89ece6d7-0f09-4d16-8c3f-d5ac7c0496d5 req-6462b8e3-55ae-4807-83b1-bff7f6d14654 tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-89ece6d7-0f09-4d16-8c3f-d5ac7c0496d5 req-6462b8e3-55ae-4807-83b1-bff7f6d14654 tempest-TestStampPattern-199976689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:19 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2441e065-0a90-4604-a9d8-82e2ec1cf01c]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-89ece6d7-0f09-4d16-8c3f-d5ac7c0496d5 req-6462b8e3-55ae-4807-83b1-bff7f6d14654 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:19 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec Jul 07 08:36:19 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:19 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [req-89ece6d7-0f09-4d16-8c3f-d5ac7c0496d5 req-6462b8e3-55ae-4807-83b1-bff7f6d14654 tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" returned: 0 in 0.709s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [req-89ece6d7-0f09-4d16-8c3f-d5ac7c0496d5 req-6462b8e3-55ae-4807-83b1-bff7f6d14654 tempest-TestStampPattern-199976689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.728s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-89ece6d7-0f09-4d16-8c3f-d5ac7c0496d5 req-6462b8e3-55ae-4807-83b1-bff7f6d14654 tempest-TestStampPattern-199976689 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959', 'name': 'volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43f157a8-cf66-4495-9f97-f6faa9646f87', 'enforce_multipath': True} {{(pid=87179) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 08:36:19 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-89ece6d7-0f09-4d16-8c3f-d5ac7c0496d5 req-6462b8e3-55ae-4807-83b1-bff7f6d14654 tempest-TestStampPattern-199976689 None] attachment_update completed successfully. Jul 07 08:36:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [req-199599cd-4229-48ec-9c48-81e97c512195 req-ff6208d3-9a9f-4c3e-8d22-48d5d40108e4 tempest-TestStampPattern-199976689 None] Terminate volume connection completed successfully. Jul 07 08:36:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [req-199599cd-4229-48ec-9c48-81e97c512195 req-ff6208d3-9a9f-4c3e-8d22-48d5d40108e4 tempest-TestStampPattern-199976689 None] Deleting attachment 43f157a8-cf66-4495-9f97-f6faa9646f87. {{(pid=87179) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 08:36:29 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:36:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Acquiring lock "cinder-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Lock "cinder-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Acquiring lock "cinder-quobyte-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc1da17-2a88-4119-9677-cefa3d1232cd]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:36 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec Jul 07 08:36:36 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:36 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" returned: 0 in 0.755s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:37 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec Jul 07 08:36:37 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:37 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" returned: 0 in 0.616s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec" released by "delete_volume" :: held 1.412s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Created reservations ['ddf77add-f5f6-43ab-8d13-3e41167af181', '3d3a6b64-29bd-4d30-93f4-ac2456f8de73', 'fe648261-8fc4-4e7e-860d-b8f930690e7d', '453606c1-189c-4cc8-8cfe-174cd3b7aaad'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:37 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:36:37 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:38 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.626s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Deleted volume successfully. Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-af6d6789-a0b0-4a75-b814-2e637fd57d7d tempest-TestStampPattern-199976689 None] Lock "cinder-e5ded87c-bd34-4571-a3b8-ed3cdbfcf7ec-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Acquiring lock "cinder-f3646d2a-cece-4fb5-831c-034170f95d7a-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Lock "cinder-f3646d2a-cece-4fb5-831c-034170f95d7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Acquiring lock "cinder-quobyte-320743f2-c8d4-429a-ae48-7ba49f28625c" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-320743f2-c8d4-429a-ae48-7ba49f28625c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Acquiring lock "cinder-quobyte-f3646d2a-cece-4fb5-831c-034170f95d7a" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-f3646d2a-cece-4fb5-831c-034170f95d7a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Deleting offline snapshot f3646d2a-cece-4fb5-831c-034170f95d7a of volume 320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] snapshot_file for this snap is: volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3fd705-019e-4565-b4aa-c7d1e9c652a9]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:38 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a Jul 07 08:36:38 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:39 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a" returned: 0 in 0.724s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320743f2-c8d4-429a-ae48-7ba49f28625c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:36:39 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ebc1e-8556-4ab7-87cc-82cdeecd0299]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:39 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c Jul 07 08:36:39 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:40 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c" returned: 0 in 0.706s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:40 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a Jul 07 08:36:40 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:40 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a" returned: 0 in 0.679s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:40 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a Jul 07 08:36:40 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:41 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c.f3646d2a-cece-4fb5-831c-034170f95d7a" returned: 0 in 0.617s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-f3646d2a-cece-4fb5-831c-034170f95d7a" released by "_delete_snapshot" :: held 2.822s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-320743f2-c8d4-429a-ae48-7ba49f28625c" released by "delete_snapshot" :: held 2.843s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:41 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Created reservations ['0db78571-5b47-4adc-ad96-ab6d98b134e9', '7244e83e-60e7-4e01-87b8-e9f2366984d6', '1c631a9b-231d-4b42-8539-dd2eddcecea0', '9a82b10b-dd0d-49ae-b76e-8d1270e3fe51'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:41 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Delete snapshot completed successfully. Jul 07 08:36:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-51dbfd57-ddee-4447-a838-e306718b3410 tempest-TestStampPattern-199976689 None] Lock "cinder-f3646d2a-cece-4fb5-831c-034170f95d7a-delete_snapshot" released by "delete_snapshot" :: held 2.978s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Acquiring lock "cinder-320743f2-c8d4-429a-ae48-7ba49f28625c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Lock "cinder-320743f2-c8d4-429a-ae48-7ba49f28625c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Acquiring lock "cinder-quobyte-320743f2-c8d4-429a-ae48-7ba49f28625c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:36:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-320743f2-c8d4-429a-ae48-7ba49f28625c" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:36:49 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa47f51a-107e-4833-b920-164600d3627d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:36:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:50 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c Jul 07 08:36:50 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:50 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c" returned: 0 in 0.705s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:50 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c Jul 07 08:36:50 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:51 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-320743f2-c8d4-429a-ae48-7ba49f28625c" returned: 0 in 0.614s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Lock "cinder-quobyte-320743f2-c8d4-429a-ae48-7ba49f28625c" released by "delete_volume" :: held 1.376s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Created reservations ['a6495458-0e1d-42db-bd8f-81add2e5cc37', '38ef0a56-40cf-42fa-b561-d78eb5265b9c', '04392038-2c9c-4fea-a291-f2fe0e63f9da', 'e8dce5f4-43e8-4f4f-82ab-58c7133e68c8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:36:51 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:36:51 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:36:51 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.615s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:36:51 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:36:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Deleted volume successfully. Jul 07 08:36:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-12d848e7-0dae-49c9-8405-ebb521d9a6cc tempest-TestStampPattern-199976689 None] Lock "cinder-320743f2-c8d4-429a-ae48-7ba49f28625c-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:01 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=18,cinder:SELECT=15,cinder:INSERT=6 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:37:01 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Flow 'volume_create_manager' (2ed1455e-04de-4c37-b3cb-804845f7d4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcbc421-f173-4853-9ddb-fac16f7a8a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcbc421-f173-4853-9ddb-fac16f7a8a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51d5c39-14a8-43dc-a2a7-0a15e6200417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9548845e03a14a199df445e0b5d62063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:05Z,use_quota=True,user_id='983340d2391c47dda3337e307312c738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e568e-c010-4d32-82cd-d93ed1bc42ca),volume_type_id=8b2e568e-c010-4d32-82cd-d93ed1bc42ca)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bfe6ef-f1cc-4a9b-af24-2e1d366c010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bfe6ef-f1cc-4a9b-af24-2e1d366c010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f149e16-e92d-4dcd-b5be-0b42c47a7d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.image.glance [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Creating Keystone auth plugin from conf {{(pid=87179) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:04 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:37:04 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f149e16-e92d-4dcd-b5be-0b42c47a7d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd51d5c39-14a8-43dc-a2a7-0a15e6200417', 'volume_name': 'volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417', 'volume_size': 1, 'image_id': '5c774e5e-7990-4451-a877-81969407f52f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c774e5e-7990-4451-a877-81969407f52f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc354c15318c3f9df6130e22a0c40706', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9548845e03a14a199df445e0b5d62063', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30598900146b3a96a05bd5c4e2d091b3f321788a792c5e5e925a9fad391299ddd4846924191fc36ffe65f7a523b2ac80ed6e1e7640f9d57c45f27ce3820fc48f', 'id': '5c774e5e-7990-4451-a877-81969407f52f', 'created_at': datetime.datetime(2026, 7, 7, 6, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 37, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c774e5e-7990-4451-a877-81969407f52f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a782fe05-53b5-4efc-8297-e50b0e874115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a782fe05-53b5-4efc-8297-e50b0e874115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d32a9af-7b14-42aa-a83b-10347ce1f7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:04 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Volume d51d5c39-14a8-43dc-a2a7-0a15e6200417: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417', 'volume_size': 1, 'image_id': '5c774e5e-7990-4451-a877-81969407f52f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c774e5e-7990-4451-a877-81969407f52f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc354c15318c3f9df6130e22a0c40706', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9548845e03a14a199df445e0b5d62063', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30598900146b3a96a05bd5c4e2d091b3f321788a792c5e5e925a9fad391299ddd4846924191fc36ffe65f7a523b2ac80ed6e1e7640f9d57c45f27ce3820fc48f', 'id': '5c774e5e-7990-4451-a877-81969407f52f', 'created_at': datetime.datetime(2026, 7, 7, 6, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 37, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c774e5e-7990-4451-a877-81969407f52f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Trying to clone d51d5c39-14a8-43dc-a2a7-0a15e6200417 from image 5c774e5e-7990-4451-a877-81969407f52f at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c774e5e-7990-4451-a877-81969407f52f', 'metadata': {}}]). {{(pid=87179) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:37:04 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:37:04 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Image download 0.00 MB at 0.00 MB/s Jul 07 08:37:05 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d64c8b-724c-4ade-b4f3-e3dd419b140e]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:05 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD Jul 07 08:37:05 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:05 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.660s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:37:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:37:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:37:05 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD" returned: 0 in 0.695s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:05 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD Jul 07 08:37:05 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:06 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD" returned: 1 in 0.687s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:37:06 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Temporary image 5c774e5e-7990-4451-a877-81969407f52f is fetched for user 983340d2391c47dda3337e307312c738. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:37:06 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b81487-314b-4fc2-98f6-6c7c28b0636e]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:06 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD Jul 07 08:37:06 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:07 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD" returned: 0 in 0.683s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:07 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD Jul 07 08:37:07 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:07 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD" returned: 1 in 0.681s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51d5c39-14a8-43dc-a2a7-0a15e6200417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9548845e03a14a199df445e0b5d62063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:05Z,use_quota=True,user_id='983340d2391c47dda3337e307312c738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b2e568e-c010-4d32-82cd-d93ed1bc42ca),volume_type_id=8b2e568e-c010-4d32-82cd-d93ed1bc42ca)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Creating volume d51d5c39-14a8-43dc-a2a7-0a15e6200417 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:07 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:07 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 1073741824 Jul 07 08:37:07 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:08 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 1073741824" returned: 0 in 0.766s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:08 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 Jul 07 08:37:08 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:09 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417" returned: 0 in 0.642s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:09 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:09 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Attempting download of 5c774e5e-7990-4451-a877-81969407f52f ((None, [{'url': 'file:///opt/stack/data/glance/images/5c774e5e-7990-4451-a877-81969407f52f', 'metadata': {}}])) to volume d51d5c39-14a8-43dc-a2a7-0a15e6200417. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:37:09 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dbc876-59ef-4396-a561-febf121a59c7]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c774e5e-7990-4451-a877-81969407f52f_umiptnqy {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:09 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c774e5e-7990-4451-a877-81969407f52f_umiptnqy Jul 07 08:37:09 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:10 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c774e5e-7990-4451-a877-81969407f52f_umiptnqy" returned: 0 in 0.693s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c774e5e-7990-4451-a877-81969407f52f_umiptnqy {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:10 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c774e5e-7990-4451-a877-81969407f52f_umiptnqy Jul 07 08:37:10 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:10 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c774e5e-7990-4451-a877-81969407f52f_umiptnqy" returned: 1 in 0.674s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c774e5e-7990-4451-a877-81969407f52f_umiptnqy' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:37:10 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a649b81b-9a5c-4fab-8afc-da958c197d29]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:10 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD Jul 07 08:37:10 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:11 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD" returned: 0 in 0.673s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:11 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD Jul 07 08:37:11 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:12 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD" returned: 1 in 0.687s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:37:12 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] 5c774e5e-7990-4451-a877-81969407f52f was raw, converting to raw {{(pid=87179) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:37:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:12 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 Jul 07 08:37:12 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:12 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417" returned: 0 in 0.690s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:12 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c774e5e-7990-4451-a877-81969407f52f_coolh5k6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:37:12 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 08:37:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:12 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 1G Jul 07 08:37:12 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:13 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 1G" returned: 0 in 0.642s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:13 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f4d764-dd19-4a2e-be84-c66c63faa1e4]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:13 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 Jul 07 08:37:13 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:14 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417" returned: 0 in 0.697s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:14 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 Jul 07 08:37:14 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:14 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417" returned: 1 in 0.712s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Downloaded image 5c774e5e-7990-4451-a877-81969407f52f ((None, [{'url': 'file:///opt/stack/data/glance/images/5c774e5e-7990-4451-a877-81969407f52f', 'metadata': {}}])) to volume d51d5c39-14a8-43dc-a2a7-0a15e6200417 successfully. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Temporary image 5c774e5e-7990-4451-a877-81969407f52f for user 983340d2391c47dda3337e307312c738 is deleted. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Marking volume d51d5c39-14a8-43dc-a2a7-0a15e6200417 as bootable. {{(pid=87179) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Copying metadata from image 5c774e5e-7990-4451-a877-81969407f52f to d51d5c39-14a8-43dc-a2a7-0a15e6200417. {{(pid=87179) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Creating volume glance metadata for volume d51d5c39-14a8-43dc-a2a7-0a15e6200417 backed by image 5c774e5e-7990-4451-a877-81969407f52f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5c774e5e-7990-4451-a877-81969407f52f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fc354c15318c3f9df6130e22a0c40706', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87179) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d32a9af-7b14-42aa-a83b-10347ce1f7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417', 'volume_size': 1, 'image_id': '5c774e5e-7990-4451-a877-81969407f52f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c774e5e-7990-4451-a877-81969407f52f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc354c15318c3f9df6130e22a0c40706', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9548845e03a14a199df445e0b5d62063', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30598900146b3a96a05bd5c4e2d091b3f321788a792c5e5e925a9fad391299ddd4846924191fc36ffe65f7a523b2ac80ed6e1e7640f9d57c45f27ce3820fc48f', 'id': '5c774e5e-7990-4451-a877-81969407f52f', 'created_at': datetime.datetime(2026, 7, 7, 6, 37, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 37, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c774e5e-7990-4451-a877-81969407f52f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad40496-9a75-45cb-9c1b-7508a7d71626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:14 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Volume volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 (d51d5c39-14a8-43dc-a2a7-0a15e6200417): created successfully Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad40496-9a75-45cb-9c1b-7508a7d71626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:14 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Flow 'volume_create_manager' (2ed1455e-04de-4c37-b3cb-804845f7d4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a8028570-8c70-4b97-aa4f-e0f5e4e681a4 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Created volume successfully. Jul 07 08:37:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Acquiring lock "cinder-d51d5c39-14a8-43dc-a2a7-0a15e6200417-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "cinder-d51d5c39-14a8-43dc-a2a7-0a15e6200417-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Acquiring lock "cinder-quobyte-d51d5c39-14a8-43dc-a2a7-0a15e6200417" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "cinder-quobyte-d51d5c39-14a8-43dc-a2a7-0a15e6200417" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:15 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ccbda5-53de-49db-a822-0fec5a0181c3]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:15 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 Jul 07 08:37:15 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:15 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417" returned: 0 in 0.700s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:16 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 Jul 07 08:37:16 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:16 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417" returned: 1 in 0.711s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:37:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:16 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417 Jul 07 08:37:16 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:17 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d51d5c39-14a8-43dc-a2a7-0a15e6200417" returned: 0 in 0.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "cinder-quobyte-d51d5c39-14a8-43dc-a2a7-0a15e6200417" released by "delete_volume" :: held 2.126s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:17 devstack cinder-volume[87179]: WARNING cinder.quota [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:37:17 devstack cinder-volume[87179]: WARNING cinder.quota [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 08:37:17 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Created reservations ['6904afd4-acd0-4cde-9251-ed0b54da0af4', 'a28c2cb6-e754-4ebd-9fe5-f1e9f9d4f03d', 'c5cc8c11-02bd-435f-a1df-856436d644cd', 'cf43b728-e23c-47d9-acb4-bf0b137fe644'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:17 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:37:17 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:18 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.613s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:18 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:18 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Deleted volume successfully. Jul 07 08:37:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a9852f3-af4e-4340-a406-f5a63023aad1 tempest-VolumeAndVolumeTypeFromImageTest-672514934 None] Lock "cinder-d51d5c39-14a8-43dc-a2a7-0a15e6200417-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:27 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=12,cinder:SELECT=12,cinder:INSERT=8 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:37:30 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (7c99f1b9-0fe2-4b0d-b1bd-a83e03253bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854f8153-1ea2-4029-a83c-f8bc435e4e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854f8153-1ea2-4029-a83c-f8bc435e4e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1899169543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:31Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939a23b9-9ebb-4432-90a5-7316ff18d3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939a23b9-9ebb-4432-90a5-7316ff18d3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a04532f-d8f2-42a5-acf7-60fe6a2aa053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a04532f-d8f2-42a5-acf7-60fe6a2aa053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca', 'volume_name': 'volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c0d190-26c4-47af-9403-367a334db364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c0d190-26c4-47af-9403-367a334db364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3511135-4095-4aef-905b-c1739e8e7f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume 54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca', 'volume_size': 1} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1899169543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:31Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Creating volume 54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:31 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:31 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca 1073741824 Jul 07 08:37:31 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (c36b0706-5217-4c54-a3fc-152af2a8fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4efea3f-68a6-461e-a466-e5081d89eb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4efea3f-68a6-461e-a466-e5081d89eb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276483122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988a2549-6132-47ec-8bcc-c4e4b87fcc7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:31Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd53140-0879-4659-8804-e94663814d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd53140-0879-4659-8804-e94663814d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adb1d72-a620-4bab-9964-aefbcc9ea9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adb1d72-a620-4bab-9964-aefbcc9ea9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988a2549-6132-47ec-8bcc-c4e4b87fcc7f', 'volume_name': 'volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e23890-76e3-4a93-87be-91fbcbcec456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e23890-76e3-4a93-87be-91fbcbcec456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a4a80a-4f4c-4e77-a706-f28b4f0c7b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume 988a2549-6132-47ec-8bcc-c4e4b87fcc7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f', 'volume_size': 1} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (feb97507-0e01-44e8-8bf9-2764c18bfb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e23b796-a02b-4892-a6cf-1db3ebf995a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e23b796-a02b-4892-a6cf-1db3ebf995a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-469904513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3a294a-79bf-483b-b06f-8192118d409b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:32Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6b57af-c08f-4f0d-bdbf-6cd4d4db556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6b57af-c08f-4f0d-bdbf-6cd4d4db556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a88ac82-65c6-4e98-9737-df8cc7073f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a88ac82-65c6-4e98-9737-df8cc7073f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3a294a-79bf-483b-b06f-8192118d409b', 'volume_name': 'volume-df3a294a-79bf-483b-b06f-8192118d409b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c63836-0ecb-4440-bf93-7a3130f23aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c63836-0ecb-4440-bf93-7a3130f23aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d52106-13c5-4ba8-afd1-1f403adc9c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Volume df3a294a-79bf-483b-b06f-8192118d409b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3a294a-79bf-483b-b06f-8192118d409b', 'volume_size': 1} Jul 07 08:37:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (51b2f0a3-8383-45bd-8445-a65b4c887701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e962f4-bedd-470c-9f21-b9395b23d50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e962f4-bedd-470c-9f21-b9395b23d50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-254637293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52290a6c-efe1-45ca-b09f-7eb6a7154910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:32Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32be335-7657-4960-be8b-c136b518b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32be335-7657-4960-be8b-c136b518b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9e2a6-d2fd-4f80-b30e-ab78f5245d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9e2a6-d2fd-4f80-b30e-ab78f5245d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52290a6c-efe1-45ca-b09f-7eb6a7154910', 'volume_name': 'volume-52290a6c-efe1-45ca-b09f-7eb6a7154910', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ab1a9b-ccb6-444f-bd03-35f330dea6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ab1a9b-ccb6-444f-bd03-35f330dea6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff0bb6b-5bd1-4256-a478-11ce618e0a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Volume 52290a6c-efe1-45ca-b09f-7eb6a7154910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52290a6c-efe1-45ca-b09f-7eb6a7154910', 'volume_size': 1} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca 1073741824" returned: 0 in 1.083s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:32 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca Jul 07 08:37:32 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (64dfc81d-3439-467d-b03c-7422ff017460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e8b224-9d2b-4f43-8ed0-584ed7a07967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e8b224-9d2b-4f43-8ed0-584ed7a07967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034949606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db2b2a5-387d-4a74-99d5-109d35c0aaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:32Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c19748d-a4c2-44e4-b669-c7f4c735dcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c19748d-a4c2-44e4-b669-c7f4c735dcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2de82f-da31-47c9-a5c1-595781e68fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2de82f-da31-47c9-a5c1-595781e68fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db2b2a5-387d-4a74-99d5-109d35c0aaf1', 'volume_name': 'volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ff847c-f142-499f-8634-92aae45e7019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ff847c-f142-499f-8634-92aae45e7019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f672939c-a250-4c1e-a6fe-a2391ad984f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Volume 3db2b2a5-387d-4a74-99d5-109d35c0aaf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1', 'volume_size': 1} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (1d024db7-d332-414b-a029-fd710381584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8344a9f-b31d-4f85-bd4e-899d065fa63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8344a9f-b31d-4f85-bd4e-899d065fa63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1322664880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b3303b-bf3c-48af-a273-dfe9e0d39f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:33Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d6ddc8-fd32-4fcb-877a-289108f3c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d6ddc8-fd32-4fcb-877a-289108f3c077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf3a9f3-304e-4cbc-ac3a-8da5cdcda7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf3a9f3-304e-4cbc-ac3a-8da5cdcda7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b3303b-bf3c-48af-a273-dfe9e0d39f43', 'volume_name': 'volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa29243-378a-4095-a649-ec7ab30346e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa29243-378a-4095-a649-ec7ab30346e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c63855-87b7-4b79-9b20-c15cf9473bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:32 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Volume 40b3303b-bf3c-48af-a273-dfe9e0d39f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43', 'volume_size': 1} Jul 07 08:37:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:33 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca" returned: 0 in 0.849s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.858s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276483122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988a2549-6132-47ec-8bcc-c4e4b87fcc7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:31Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Creating volume 988a2549-6132-47ec-8bcc-c4e4b87fcc7f {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:33 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:33 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f 1073741824 Jul 07 08:37:33 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3511135-4095-4aef-905b-c1739e8e7f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b991d6-ae4b-4f99-ae19-7a6dc3e3661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca (54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca): created successfully Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b991d6-ae4b-4f99-ae19-7a6dc3e3661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (7c99f1b9-0fe2-4b0d-b1bd-a83e03253bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-485f55e3-549d-45ba-856d-e0b7a6637389 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created volume successfully. Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (3ad6684a-4d58-4776-91f1-e50bdd0a0bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99079670-6ec4-45e5-b695-36a44b052bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99079670-6ec4-45e5-b695-36a44b052bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2062684067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cacedae-d391-43b5-8267-a8b26b753a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:33Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd20f59-bf32-4754-895e-be24d2698b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd20f59-bf32-4754-895e-be24d2698b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5b876d-426c-45a9-a5fa-470aa4407990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5b876d-426c-45a9-a5fa-470aa4407990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cacedae-d391-43b5-8267-a8b26b753a4c', 'volume_name': 'volume-8cacedae-d391-43b5-8267-a8b26b753a4c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befcd604-eefe-4056-ac2a-c1b12329faf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befcd604-eefe-4056-ac2a-c1b12329faf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51071d7c-2b05-44e4-84d9-80b59f8b6524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Volume 8cacedae-d391-43b5-8267-a8b26b753a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cacedae-d391-43b5-8267-a8b26b753a4c', 'volume_size': 1} Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:33 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f 1073741824" returned: 0 in 0.837s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:34 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f Jul 07 08:37:34 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (4e968e86-f900-4dc7-b5a8-2670fcc0e9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47caec7f-9557-4803-a9c9-7eae9b9ff4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47caec7f-9557-4803-a9c9-7eae9b9ff4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482465479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a12882a-fd9d-4dce-b56f-3be12c5a0fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:35Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4493b5c-3fa7-45a9-8dc8-ab1c04905c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4493b5c-3fa7-45a9-8dc8-ab1c04905c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015726cd-752b-4d1c-932f-421c87b93359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015726cd-752b-4d1c-932f-421c87b93359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a12882a-fd9d-4dce-b56f-3be12c5a0fad', 'volume_name': 'volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da49c488-223f-4a1e-b80d-cf861a12499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da49c488-223f-4a1e-b80d-cf861a12499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3968fab-61cc-4014-b249-f07de7b7a56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:34 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume 3a12882a-fd9d-4dce-b56f-3be12c5a0fad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad', 'volume_size': 1} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:34 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" returned: 0 in 0.813s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.106s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-469904513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3a294a-79bf-483b-b06f-8192118d409b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:32Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Creating volume df3a294a-79bf-483b-b06f-8192118d409b {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:34 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:34 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b 1073741824 Jul 07 08:37:34 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a4a80a-4f4c-4e77-a706-f28b4f0c7b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6308e16-c995-4a9f-9410-6fe29a009ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:34 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f (988a2549-6132-47ec-8bcc-c4e4b87fcc7f): created successfully Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6308e16-c995-4a9f-9410-6fe29a009ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (c36b0706-5217-4c54-a3fc-152af2a8fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:34 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f8c88d9a-0309-4773-934d-5bc7d5c9022a tempest-CreateVolumesFromSnapshotTest-550584963 None] Created volume successfully. Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Flow 'volume_create_manager' (97e751c1-d445-483d-9471-17f1a7209075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2144d7f-79d4-4b65-96f4-e1705094985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2144d7f-79d4-4b65-96f4-e1705094985e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ea1f6a-70eb-4cce-923d-4b2937d4b888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba44933193a745c6a2e15202d714ee9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:35Z,use_quota=True,user_id='f2f0c0c0c0cb43ad99285e6e11b456ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2d593b1-2a18-4f6f-970e-583bbfaa2136),volume_type_id=b2d593b1-2a18-4f6f-970e-583bbfaa2136)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d58cbb6-3a53-4e56-9df5-a693c9724e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d58cbb6-3a53-4e56-9df5-a693c9724e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bd0ffd-636a-4471-bc74-3c13b5019966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.image.glance [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Creating Keystone auth plugin from conf {{(pid=87179) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (97ed778e-40a4-4387-b91a-5c8fdab119f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46267f2-d3a3-41ee-97ba-195ecf3c8999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46267f2-d3a3-41ee-97ba-195ecf3c8999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556879801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed0ee82-c346-4f54-a6f8-73bbd27c586b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:35Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a791992a-6db3-484b-928d-b76b8623bc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a791992a-6db3-484b-928d-b76b8623bc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278310ad-f738-490b-9659-05483c46a51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278310ad-f738-490b-9659-05483c46a51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed0ee82-c346-4f54-a6f8-73bbd27c586b', 'volume_name': 'volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a7c0bc-b2f8-4ebf-be3b-2aa3d72f66a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a7c0bc-b2f8-4ebf-be3b-2aa3d72f66a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef16ed85-55f8-4df8-8b2d-a2daf31ef0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume aed0ee82-c346-4f54-a6f8-73bbd27c586b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b', 'volume_size': 1} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bd0ffd-636a-4471-bc74-3c13b5019966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '78ea1f6a-70eb-4cce-923d-4b2937d4b888', 'volume_name': 'volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888', 'volume_size': 1, 'image_id': '6a52974f-0060-403f-8751-013b99282005', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a52974f-0060-403f-8751-013b99282005', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7690dd5b48ae2c670bec5b3c757713f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ba44933193a745c6a2e15202d714ee9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0f33cea55b02baae54ec3fddc7c9086da09cf464d6b1fd02e5d4ff500719fae7a94b8c9f70644ddfbecedae833706cddf60e0cf54684912ff838d2d58ab0ee6a', 'id': '6a52974f-0060-403f-8751-013b99282005', 'created_at': datetime.datetime(2026, 7, 7, 6, 37, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 37, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a52974f-0060-403f-8751-013b99282005/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103bd666-85ce-4710-8dd2-0ca43eeb6596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103bd666-85ce-4710-8dd2-0ca43eeb6596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8135822d-c4da-44f4-b47e-154f2f6ce128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Volume 78ea1f6a-70eb-4cce-923d-4b2937d4b888: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888', 'volume_size': 1, 'image_id': '6a52974f-0060-403f-8751-013b99282005', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a52974f-0060-403f-8751-013b99282005', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7690dd5b48ae2c670bec5b3c757713f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ba44933193a745c6a2e15202d714ee9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0f33cea55b02baae54ec3fddc7c9086da09cf464d6b1fd02e5d4ff500719fae7a94b8c9f70644ddfbecedae833706cddf60e0cf54684912ff838d2d58ab0ee6a', 'id': '6a52974f-0060-403f-8751-013b99282005', 'created_at': datetime.datetime(2026, 7, 7, 6, 37, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 37, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a52974f-0060-403f-8751-013b99282005/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Trying to clone 78ea1f6a-70eb-4cce-923d-4b2937d4b888 from image 6a52974f-0060-403f-8751-013b99282005 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6a52974f-0060-403f-8751-013b99282005', 'metadata': {}}]). {{(pid=87179) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:37:35 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Image download 0.00 MB at 0.00 MB/s Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (80f3e372-dd8f-4189-987f-38689599ca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd23ed7-32e0-4f21-9525-7a58c409ce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd23ed7-32e0-4f21-9525-7a58c409ce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029575643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6a131b-bcee-4f83-b523-5abd537cc347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:36Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1166ff04-64f6-4279-b4ea-4d384a882d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1166ff04-64f6-4279-b4ea-4d384a882d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0e5208-f388-46d4-aaf5-6d67002f7fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0e5208-f388-46d4-aaf5-6d67002f7fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6a131b-bcee-4f83-b523-5abd537cc347', 'volume_name': 'volume-2d6a131b-bcee-4f83-b523-5abd537cc347', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3082e03-daac-4cd1-8754-3df3d1eef259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3082e03-daac-4cd1-8754-3df3d1eef259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9abe68-af2e-496d-bcd3-4f0736cf3176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume 2d6a131b-bcee-4f83-b523-5abd537cc347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6a131b-bcee-4f83-b523-5abd537cc347', 'volume_size': 1} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[add2c794-4541-49a3-8244-6a387c38fc7c]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:35 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b 1073741824" returned: 0 in 1.019s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:35 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD Jul 07 08:37:35 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:35 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b Jul 07 08:37:35 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (f3a27183-28be-434a-890d-ddca7521dd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278f1df3-fb47-4b2c-be8a-33fa0c2173a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278f1df3-fb47-4b2c-be8a-33fa0c2173a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1098240870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d432a26-d0a7-4486-8d79-12f1476358ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:36Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0621865a-3619-41d8-9773-53e446c5a8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0621865a-3619-41d8-9773-53e446c5a8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4655e7ea-7ece-4f5a-913c-601b91fdf8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4655e7ea-7ece-4f5a-913c-601b91fdf8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d432a26-d0a7-4486-8d79-12f1476358ad', 'volume_name': 'volume-7d432a26-d0a7-4486-8d79-12f1476358ad', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daca6da-6ec6-434a-bff8-ac52346bb5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daca6da-6ec6-434a-bff8-ac52346bb5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdade72-c9b2-466e-9633-da0f9a1cadcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume 7d432a26-d0a7-4486-8d79-12f1476358ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d432a26-d0a7-4486-8d79-12f1476358ad', 'volume_size': 1} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:36 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b" returned: 0 in 0.767s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.471s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-254637293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52290a6c-efe1-45ca-b09f-7eb6a7154910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:32Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Creating volume 52290a6c-efe1-45ca-b09f-7eb6a7154910 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:36 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:36 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 1073741824 Jul 07 08:37:36 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d52106-13c5-4ba8-afd1-1f403adc9c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3a294a-79bf-483b-b06f-8192118d409b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d039a1e6-1fa3-496f-ae4c-ccf35060d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (60dad4fe-aed0-4e9f-a53f-63586cdad5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9baf00f2-2942-43e0-ae08-17dfec0861cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD" returned: 0 in 1.050s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9baf00f2-2942-43e0-ae08-17dfec0861cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927446886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d11f84-1b03-4079-80e2-ac854dda906c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:37Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56426ab6-986c-4fbe-b405-534d77d37e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56426ab6-986c-4fbe-b405-534d77d37e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7149e48-e3b7-46ed-b178-e2e24338e764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7149e48-e3b7-46ed-b178-e2e24338e764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d11f84-1b03-4079-80e2-ac854dda906c', 'volume_name': 'volume-32d11f84-1b03-4079-80e2-ac854dda906c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666f9666-bfdf-4809-ad4d-ed1e4e7bb1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666f9666-bfdf-4809-ad4d-ed1e4e7bb1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5a6159-a0ae-4a45-91d4-c17b78ccfb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:36 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume 32d11f84-1b03-4079-80e2-ac854dda906c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d11f84-1b03-4079-80e2-ac854dda906c', 'volume_size': 1} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:36 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Volume volume-df3a294a-79bf-483b-b06f-8192118d409b (df3a294a-79bf-483b-b06f-8192118d409b): created successfully Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d039a1e6-1fa3-496f-ae4c-ccf35060d14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (feb97507-0e01-44e8-8bf9-2764c18bfb91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8e1e6b75-1b08-46d3-8403-2c4dc3b92ff7 tempest-CreateVolumesFromImageTest-899524227 None] Created volume successfully. Jul 07 08:37:36 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD Jul 07 08:37:36 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:37 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD" returned: 1 in 0.706s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:37:37 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Temporary image 6a52974f-0060-403f-8751-013b99282005 is fetched for user f2f0c0c0c0cb43ad99285e6e11b456ed. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:37:37 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 1073741824" returned: 0 in 0.839s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb186593-c933-4396-a4f4-5682c892e198]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:37 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 Jul 07 08:37:37 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:37 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD Jul 07 08:37:37 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:38 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910" returned: 0 in 0.629s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.623s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034949606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db2b2a5-387d-4a74-99d5-109d35c0aaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:32Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Creating volume 3db2b2a5-387d-4a74-99d5-109d35c0aaf1 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:38 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff0bb6b-5bd1-4256-a478-11ce618e0a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52290a6c-efe1-45ca-b09f-7eb6a7154910', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde9fb5c-fcfc-4feb-a013-0ee9c83aafc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:38 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 1073741824 Jul 07 08:37:38 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:38 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Volume volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 (52290a6c-efe1-45ca-b09f-7eb6a7154910): created successfully Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde9fb5c-fcfc-4feb-a013-0ee9c83aafc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (51b2f0a3-8383-45bd-8445-a65b4c887701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-33d8cd41-f9ee-4412-87eb-e91b03de83bd tempest-CreateVolumesFromImageTest-899524227 None] Created volume successfully. Jul 07 08:37:38 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:38 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD Jul 07 08:37:38 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:39 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD" returned: 1 in 0.723s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:39 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 1073741824" returned: 0 in 0.809s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:39 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 Jul 07 08:37:39 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:39 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1" returned: 0 in 0.616s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.705s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1322664880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b3303b-bf3c-48af-a273-dfe9e0d39f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:33Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Creating volume 40b3303b-bf3c-48af-a273-dfe9e0d39f43 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:39 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:39 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 1073741824 Jul 07 08:37:39 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f672939c-a250-4c1e-a6fe-a2391ad984f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b938356-835d-43bd-a927-4bbb746f1816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:39 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Volume volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 (3db2b2a5-387d-4a74-99d5-109d35c0aaf1): created successfully Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b938356-835d-43bd-a927-4bbb746f1816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:39 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (64dfc81d-3439-467d-b03c-7422ff017460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:39 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e6122e2e-7a46-4807-849b-c26b54f435ec tempest-CreateVolumesFromImageTest-899524227 None] Created volume successfully. Jul 07 08:37:40 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 1073741824" returned: 0 in 0.811s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:40 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 Jul 07 08:37:40 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:41 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43" returned: 0 in 0.606s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.719s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2062684067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cacedae-d391-43b5-8267-a8b26b753a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf020be85824537b08990ca65a2c108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:33Z,use_quota=True,user_id='683b7036f0844b86bc657521b4fcf0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Creating volume 8cacedae-d391-43b5-8267-a8b26b753a4c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:41 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:41 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c 1073741824 Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c63855-87b7-4b79-9b20-c15cf9473bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:41 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bdfc1d-c6b5-4af2-82a9-4db0ada197d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:41 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Volume volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 (40b3303b-bf3c-48af-a273-dfe9e0d39f43): created successfully Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bdfc1d-c6b5-4af2-82a9-4db0ada197d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (1d024db7-d332-414b-a029-fd710381584d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:41 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-eff3cdc0-fde7-4a96-bbaf-7596f8b7b47a tempest-CreateVolumesFromImageTest-899524227 None] Created volume successfully. Jul 07 08:37:41 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c 1073741824" returned: 0 in 0.769s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:41 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c Jul 07 08:37:41 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:42 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c" returned: 0 in 0.624s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.766s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482465479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a12882a-fd9d-4dce-b56f-3be12c5a0fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:35Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Creating volume 3a12882a-fd9d-4dce-b56f-3be12c5a0fad {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:42 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:42 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad 1073741824 Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51071d7c-2b05-44e4-84d9-80b59f8b6524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cacedae-d391-43b5-8267-a8b26b753a4c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:42 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414bd3c2-6615-4261-865d-ebef76221fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:42 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Volume volume-8cacedae-d391-43b5-8267-a8b26b753a4c (8cacedae-d391-43b5-8267-a8b26b753a4c): created successfully Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414bd3c2-6615-4261-865d-ebef76221fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:42 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Flow 'volume_create_manager' (3ad6684a-4d58-4776-91f1-e50bdd0a0bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:42 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e95609be-5e71-42ed-947e-db4d73392e0e tempest-CreateVolumesFromImageTest-899524227 None] Created volume successfully. Jul 07 08:37:43 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad 1073741824" returned: 0 in 0.768s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:43 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad Jul 07 08:37:43 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-8cacedae-d391-43b5-8267-a8b26b753a4c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-8cacedae-d391-43b5-8267-a8b26b753a4c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-quobyte-8cacedae-d391-43b5-8267-a8b26b753a4c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-8cacedae-d391-43b5-8267-a8b26b753a4c" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:43 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aea022c-f358-4e79-9f90-0a8faaf31d95]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:43 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c Jul 07 08:37:43 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:44 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad" returned: 0 in 0.645s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.782s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556879801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed0ee82-c346-4f54-a6f8-73bbd27c586b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:35Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Creating volume aed0ee82-c346-4f54-a6f8-73bbd27c586b {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:44 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:44 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b 1073741824 Jul 07 08:37:44 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3968fab-61cc-4014-b249-f07de7b7a56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0474586a-31d1-40fc-82c5-a2cae7e10d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:44 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad (3a12882a-fd9d-4dce-b56f-3be12c5a0fad): created successfully Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0474586a-31d1-40fc-82c5-a2cae7e10d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (4e968e86-f900-4dc7-b5a8-2670fcc0e9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:44 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6db226ae-aa77-4ea9-83ee-2f1b256cb833 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created volume successfully. Jul 07 08:37:44 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c" returned: 0 in 0.785s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:44 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c Jul 07 08:37:44 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:44 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b 1073741824" returned: 0 in 0.861s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:44 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b Jul 07 08:37:44 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:45 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8cacedae-d391-43b5-8267-a8b26b753a4c" returned: 0 in 0.662s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-8cacedae-d391-43b5-8267-a8b26b753a4c" released by "delete_volume" :: held 1.490s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Created reservations ['83c22af8-c5fe-4e0c-b015-339f7d731f4d', '95ad6a80-4708-43b1-b9f7-dd1c1ce68b37', 'b27ec32f-f966-4394-8ba5-f42b31182ef3', '61cc5ddb-b83e-4c67-bb62-3ed527d22059'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:45 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:37:45 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:45 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b" returned: 0 in 0.699s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.934s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029575643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6a131b-bcee-4f83-b523-5abd537cc347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:36Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Creating volume 2d6a131b-bcee-4f83-b523-5abd537cc347 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:45 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-40b3303b-bf3c-48af-a273-dfe9e0d39f43-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:45 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347 1073741824 Jul 07 08:37:45 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef16ed85-55f8-4df8-8b2d-a2daf31ef0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59f40a8-8246-43d1-83b7-72ef94132615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-40b3303b-bf3c-48af-a273-dfe9e0d39f43-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:45 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b (aed0ee82-c346-4f54-a6f8-73bbd27c586b): created successfully Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59f40a8-8246-43d1-83b7-72ef94132615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (97ed778e-40a4-4387-b91a-5c8fdab119f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-197ec718-4f19-44dd-b366-98ce4abe61c9 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created volume successfully. Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-quobyte-40b3303b-bf3c-48af-a273-dfe9e0d39f43" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-40b3303b-bf3c-48af-a273-dfe9e0d39f43" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:45 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.697s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Deleted volume successfully. Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a00255-998e-4eb4-aa21-8dcaf0998ea5]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a3dbb37c-27a3-4b78-882b-7234844d9f93 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-8cacedae-d391-43b5-8267-a8b26b753a4c-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:45 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 Jul 07 08:37:45 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:46 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347 1073741824" returned: 0 in 0.903s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:46 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347 Jul 07 08:37:46 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:46 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43" returned: 0 in 0.855s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:46 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43 Jul 07 08:37:46 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:47 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347" returned: 0 in 0.653s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.909s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Creating offline snapshot 0c6d0c64-b9ca-462b-b280-35ae82dafcfe of volume 988a2549-6132-47ec-8bcc-c4e4b87fcc7f {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9abe68-af2e-496d-bcd3-4f0736cf3176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6a131b-bcee-4f83-b523-5abd537cc347', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cc0beb-0cd5-47f2-8063-bbe02d9f17c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:47 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume volume-2d6a131b-bcee-4f83-b523-5abd537cc347 (2d6a131b-bcee-4f83-b523-5abd537cc347): created successfully Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cc0beb-0cd5-47f2-8063-bbe02d9f17c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (80f3e372-dd8f-4189-987f-38689599ca91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:47 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[19812673-729c-4233-a17e-e50acc117187]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-40b3303b-bf3c-48af-a273-dfe9e0d39f43" returned: 0 in 0.641s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-944e50e8-195c-4e49-a68d-0d52add603f5 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created volume successfully. Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-40b3303b-bf3c-48af-a273-dfe9e0d39f43" released by "delete_volume" :: held 1.554s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Created reservations ['0afb3928-9948-4ec4-aac5-e22981b423ff', 'ae3fb5db-9509-477d-8d77-bc4df8ff9f46', 'fcfee256-1daf-4057-9a77-852caae62df3', 'a34920f7-90f5-4197-b2f8-b5c4d77c441b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:47 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f Jul 07 08:37:47 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:47 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:37:47 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-3db2b2a5-387d-4a74-99d5-109d35c0aaf1-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-3db2b2a5-387d-4a74-99d5-109d35c0aaf1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-quobyte-3db2b2a5-387d-4a74-99d5-109d35c0aaf1" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-3db2b2a5-387d-4a74-99d5-109d35c0aaf1" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6977e6d6-daa2-4a9e-8023-fb0b899a1970]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:48 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" returned: 0 in 0.788s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:48 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe 1G Jul 07 08:37:48 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:48 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 Jul 07 08:37:48 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:48 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.729s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:48 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Deleted volume successfully. Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4a8b2790-aec9-4b01-8e3b-fe075f1e74c1 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-40b3303b-bf3c-48af-a273-dfe9e0d39f43-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:48 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1" returned: 0 in 0.828s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:48 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1 Jul 07 08:37:48 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:48 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe 1G" returned: 0 in 0.832s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:48 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe Jul 07 08:37:48 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:49 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3db2b2a5-387d-4a74-99d5-109d35c0aaf1" returned: 0 in 0.700s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-3db2b2a5-387d-4a74-99d5-109d35c0aaf1" released by "delete_volume" :: held 1.573s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:49 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe" returned: 0 in 0.684s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:49 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe is being set with open permissions: ugo+rw Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Created reservations ['70b02469-b934-4abd-b984-07477e285914', '27e2db02-d30d-49f0-8010-94e33a2e4cdb', '52932eda-5e8e-4207-a4b9-297fecdf75ce', '2ba6cb73-f6f8-44e1-9447-88397a1d6cfb'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:49 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe Jul 07 08:37:49 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:49 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:37:49 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-52290a6c-efe1-45ca-b09f-7eb6a7154910-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-52290a6c-efe1-45ca-b09f-7eb6a7154910-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-quobyte-52290a6c-efe1-45ca-b09f-7eb6a7154910" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-52290a6c-efe1-45ca-b09f-7eb6a7154910" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e4ec8-7432-4bca-b4e0-2a569e9d1bf3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:50 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe" returned: 0 in 0.713s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:50 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 Jul 07 08:37:50 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:50 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.info Jul 07 08:37:50 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:50 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.702s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Deleted volume successfully. Jul 07 08:37:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-61fb2e8e-4b3f-451a-8e1b-129d51e1e7bb tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-3db2b2a5-387d-4a74-99d5-109d35c0aaf1-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:51 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.info" returned: 0 in 0.689s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:51 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.info is being set with open permissions: ugo+rw Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:51 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:51 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.info Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910" returned: 0 in 0.813s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:51 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:51 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910 Jul 07 08:37:51 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:51 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.info" returned: 0 in 0.641s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.474s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.195s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1098240870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d432a26-d0a7-4486-8d79-12f1476358ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:36Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Creating volume 7d432a26-d0a7-4486-8d79-12f1476358ad {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:51 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:51 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-52290a6c-efe1-45ca-b09f-7eb6a7154910" returned: 0 in 0.667s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:51 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad 1073741824 Jul 07 08:37:51 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-52290a6c-efe1-45ca-b09f-7eb6a7154910" released by "delete_volume" :: held 1.533s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8083c4dc-dfbe-4200-be77-680f292b4e63 tempest-CreateVolumesFromSnapshotTest-550584963 None] Create snapshot completed successfully Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Created reservations ['9b8808d4-8a35-4110-844a-675caba6e72c', '2181c1f0-4495-434b-a84a-18afe41c8cad', '487d3a4a-446a-4f13-a5a0-225391e6e8ce', '11bad193-e6da-42ab-9886-1631ae1730e8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:51 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:37:51 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-df3a294a-79bf-483b-b06f-8192118d409b-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-df3a294a-79bf-483b-b06f-8192118d409b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "cinder-quobyte-df3a294a-79bf-483b-b06f-8192118d409b" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-df3a294a-79bf-483b-b06f-8192118d409b" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b64724-f843-4d1c-9e2f-9aa17aedec14]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:52 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.676s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Deleted volume successfully. Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8e4a69ec-adac-41eb-969a-a08b67b57ba9 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-52290a6c-efe1-45ca-b09f-7eb6a7154910-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:52 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b Jul 07 08:37:52 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:52 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad 1073741824" returned: 0 in 0.937s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:52 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad Jul 07 08:37:52 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (557b673c-c315-4297-9b04-504dff581155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd08ee90-cf9b-4a54-99ef-f1f252876e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd08ee90-cf9b-4a54-99ef-f1f252876e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912674240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b64c7b-f877-4754-9edd-42179baeecd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:53Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680d480e-fe3a-45fb-9aad-01d51cb34377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680d480e-fe3a-45fb-9aad-01d51cb34377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124567dc-ecc3-4773-b588-a1908d74bd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124567dc-ecc3-4773-b588-a1908d74bd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b64c7b-f877-4754-9edd-42179baeecd7', 'volume_name': 'volume-03b64c7b-f877-4754-9edd-42179baeecd7', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7c5a18-3b64-454a-af83-b8d445a93993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7c5a18-3b64-454a-af83-b8d445a93993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b7e609-b568-4001-9707-82c7ee756695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume 03b64c7b-f877-4754-9edd-42179baeecd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b64c7b-f877-4754-9edd-42179baeecd7', 'volume_size': 1} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:53 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b" returned: 0 in 0.894s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:53 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b Jul 07 08:37:53 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:53 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad" returned: 0 in 0.830s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.738s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927446886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d11f84-1b03-4079-80e2-ac854dda906c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df0bfc84d6d4333bd8adbb885128001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:37Z,use_quota=True,user_id='17c56c437fe14b3b84bbabaec374f2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Creating volume 32d11f84-1b03-4079-80e2-ac854dda906c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:53 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:53 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c 1073741824 Jul 07 08:37:53 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdade72-c9b2-466e-9633-da0f9a1cadcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d432a26-d0a7-4486-8d79-12f1476358ad', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7065569c-3089-4084-b867-6830a12da7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume volume-7d432a26-d0a7-4486-8d79-12f1476358ad (7d432a26-d0a7-4486-8d79-12f1476358ad): created successfully Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7065569c-3089-4084-b867-6830a12da7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (f3a27183-28be-434a-890d-ddca7521dd35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (e82b20e8-df5d-4f17-b617-4f123c6c53c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78336284-755a-40f4-8e00-1e70396b3066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d176da1f-42a2-4a98-92bb-ce801561e360 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created volume successfully. Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78336284-755a-40f4-8e00-1e70396b3066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1269393331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e006c1-acf1-4e31-a199-659a7e17aee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:54Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2d35c2-cd13-48f5-b3d0-ee42f358baff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2d35c2-cd13-48f5-b3d0-ee42f358baff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9c70c9-92d7-4ed6-b92e-a9c64ab34244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9c70c9-92d7-4ed6-b92e-a9c64ab34244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e006c1-acf1-4e31-a199-659a7e17aee7', 'volume_name': 'volume-13e006c1-acf1-4e31-a199-659a7e17aee7', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec92b410-6661-4766-979f-d6cea0cf33d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec92b410-6661-4766-979f-d6cea0cf33d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e5e857-6f88-4da5-9b4a-ff5ec5ca877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:53 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume 13e006c1-acf1-4e31-a199-659a7e17aee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e006c1-acf1-4e31-a199-659a7e17aee7', 'volume_size': 1} Jul 07 08:37:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (3b931fd6-f12e-4d8a-bc5c-39bfdd3a8a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84da6ebf-859b-46bb-bb9f-7206ffd826bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84da6ebf-859b-46bb-bb9f-7206ffd826bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1532247468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d2df75-cce7-48cd-8b59-c44542be396b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:54Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7d175d-1a4d-464f-9ccc-76e603d58ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7d175d-1a4d-464f-9ccc-76e603d58ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4473aeb0-9a09-4b12-bb8b-399d6da74702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4473aeb0-9a09-4b12-bb8b-399d6da74702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d2df75-cce7-48cd-8b59-c44542be396b', 'volume_name': 'volume-b4d2df75-cce7-48cd-8b59-c44542be396b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4c17b0-d1c4-4214-8cd6-535b54b1c07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4c17b0-d1c4-4214-8cd6-535b54b1c07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a65b829-4ab2-4399-900a-cf09170dfd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume b4d2df75-cce7-48cd-8b59-c44542be396b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d2df75-cce7-48cd-8b59-c44542be396b', 'volume_size': 1} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:54 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-df3a294a-79bf-483b-b06f-8192118d409b" returned: 0 in 0.923s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-quobyte-df3a294a-79bf-483b-b06f-8192118d409b" released by "delete_volume" :: held 1.864s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Created reservations ['d813ac9f-75de-402a-9504-1719a3ee2ba1', '1dfdb5ff-d680-42e1-97a0-70a665992f82', 'c77ba145-33b9-4370-854a-0622c49ae048', 'b05ea55b-f61c-491b-b57d-ec11e5f6a9b4'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (c7bf67f3-184d-4038-a4f7-647c727907c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d5d66f-03a4-4595-84ee-778bdb6a29c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d5d66f-03a4-4595-84ee-778bdb6a29c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505778380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62356656-d4e6-4607-9ed5-ba77c555da91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:54Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9651b-e66a-4306-864d-747735e74322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9651b-e66a-4306-864d-747735e74322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c838ba81-096f-4a09-94d8-4e689c2d6140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c838ba81-096f-4a09-94d8-4e689c2d6140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62356656-d4e6-4607-9ed5-ba77c555da91', 'volume_name': 'volume-62356656-d4e6-4607-9ed5-ba77c555da91', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e013688-b7c4-4d05-8a49-1fc92c126790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e013688-b7c4-4d05-8a49-1fc92c126790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355eca71-c1bf-422c-9f12-d238fcf12b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:54 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume 62356656-d4e6-4607-9ed5-ba77c555da91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62356656-d4e6-4607-9ed5-ba77c555da91', 'volume_size': 1} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:54 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c 1073741824" returned: 0 in 1.032s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:54 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:37:54 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:54 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c Jul 07 08:37:54 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (0cf5b679-8a41-4371-8989-6a3fc486f6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb109b58-c8f3-4a3a-8e92-bc95707cd0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb109b58-c8f3-4a3a-8e92-bc95707cd0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922026308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ce1fce-78b0-4e69-bab7-c5c833bf6b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:55Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2ec23b-532f-4eaa-bd06-7b1821f2c15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2ec23b-532f-4eaa-bd06-7b1821f2c15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7d0aeb-050b-423f-abd2-5897ab37dc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7d0aeb-050b-423f-abd2-5897ab37dc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ce1fce-78b0-4e69-bab7-c5c833bf6b9c', 'volume_name': 'volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0f43f3-de3a-4807-b89b-4b3031ca9534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0f43f3-de3a-4807-b89b-4b3031ca9534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1b6766-1e62-4ab6-ba0a-fdfeff28f165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:55 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume 22ce1fce-78b0-4e69-bab7-c5c833bf6b9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c', 'volume_size': 1} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:55 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.739s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Deleted volume successfully. Jul 07 08:37:55 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-1e9e8309-ceee-4b2c-8921-0e41f63feeb2 tempest-CreateVolumesFromImageTest-899524227 None] Lock "cinder-df3a294a-79bf-483b-b06f-8192118d409b-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c" returned: 0 in 0.758s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.440s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ea1f6a-70eb-4cce-923d-4b2937d4b888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba44933193a745c6a2e15202d714ee9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:35Z,use_quota=True,user_id='f2f0c0c0c0cb43ad99285e6e11b456ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2d593b1-2a18-4f6f-970e-583bbfaa2136),volume_type_id=b2d593b1-2a18-4f6f-970e-583bbfaa2136)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Creating volume 78ea1f6a-70eb-4cce-923d-4b2937d4b888 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:55 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5a6159-a0ae-4a45-91d4-c17b78ccfb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d11f84-1b03-4079-80e2-ac854dda906c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:55 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 1073741824 Jul 07 08:37:55 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a6931b-a224-49da-ae4e-5b36c8754a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:55 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Volume volume-32d11f84-1b03-4079-80e2-ac854dda906c (32d11f84-1b03-4079-80e2-ac854dda906c): created successfully Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a6931b-a224-49da-ae4e-5b36c8754a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Flow 'volume_create_manager' (60dad4fe-aed0-4e9f-a53f-63586cdad5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-961a6d9d-368d-4afb-8f76-7cd8f9772075 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created volume successfully. Jul 07 08:37:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-32d11f84-1b03-4079-80e2-ac854dda906c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-32d11f84-1b03-4079-80e2-ac854dda906c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-quobyte-32d11f84-1b03-4079-80e2-ac854dda906c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-32d11f84-1b03-4079-80e2-ac854dda906c" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:56 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[194ce2db-f394-4ed5-bb99-fcdf2adc128a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:56 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c Jul 07 08:37:56 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:56 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 1073741824" returned: 0 in 1.078s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:56 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 Jul 07 08:37:56 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:57 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c" returned: 0 in 0.881s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:57 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888" returned: 0 in 0.709s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:57 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c Jul 07 08:37:57 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.989s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912674240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b64c7b-f877-4754-9edd-42179baeecd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:53Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Creating volume 03b64c7b-f877-4754-9edd-42179baeecd7 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:57 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:57 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7 1073741824 Jul 07 08:37:57 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Attempting download of 6a52974f-0060-403f-8751-013b99282005 ((None, [{'url': 'file:///opt/stack/data/glance/images/6a52974f-0060-403f-8751-013b99282005', 'metadata': {}}])) to volume 78ea1f6a-70eb-4cce-923d-4b2937d4b888. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dab4af-866c-436f-a774-aa91433e4627]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a52974f-0060-403f-8751-013b99282005_yrtb9myv {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:57 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a52974f-0060-403f-8751-013b99282005_yrtb9myv Jul 07 08:37:57 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:58 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-32d11f84-1b03-4079-80e2-ac854dda906c" returned: 0 in 0.742s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-32d11f84-1b03-4079-80e2-ac854dda906c" released by "delete_volume" :: held 1.689s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created reservations ['76e359c8-c224-4c0f-a47b-f8245b96a718', 'a49a117a-fe05-42ae-93d4-49b93491b6ce', '33e1cfd0-f352-4865-b165-e9f89dfca86f', '0bfbe67b-50bd-40e7-8978-cc3d1222dc74'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:58 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:37:58 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:58 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a52974f-0060-403f-8751-013b99282005_yrtb9myv" returned: 0 in 0.848s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a52974f-0060-403f-8751-013b99282005_yrtb9myv {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:58 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7 1073741824" returned: 0 in 1.080s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:58 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a52974f-0060-403f-8751-013b99282005_yrtb9myv Jul 07 08:37:58 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:58 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7 Jul 07 08:37:58 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-7d432a26-d0a7-4486-8d79-12f1476358ad-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-7d432a26-d0a7-4486-8d79-12f1476358ad-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-quobyte-7d432a26-d0a7-4486-8d79-12f1476358ad" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-7d432a26-d0a7-4486-8d79-12f1476358ad" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4884e58-f1ea-4dd4-8b89-44dd37175836]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:58 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad Jul 07 08:37:58 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:59 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.045s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:37:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Deleted volume successfully. Jul 07 08:37:59 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-df4ee7bf-b479-4f6c-8ab7-196241ed53a7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-32d11f84-1b03-4079-80e2-ac854dda906c-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a52974f-0060-403f-8751-013b99282005_yrtb9myv" returned: 1 in 1.024s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a52974f-0060-403f-8751-013b99282005_yrtb9myv' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08626b9-29ae-4696-941f-775dff0ca67b]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:59 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7" returned: 0 in 0.944s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.596s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1269393331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e006c1-acf1-4e31-a199-659a7e17aee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:54Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Creating volume 13e006c1-acf1-4e31-a199-659a7e17aee7 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:37:59 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b7e609-b568-4001-9707-82c7ee756695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b64c7b-f877-4754-9edd-42179baeecd7', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8460ad72-e751-420f-8a5f-3a992c9c1b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:37:59 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7 1073741824 Jul 07 08:37:59 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:59 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume volume-03b64c7b-f877-4754-9edd-42179baeecd7 (03b64c7b-f877-4754-9edd-42179baeecd7): created successfully Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8460ad72-e751-420f-8a5f-3a992c9c1b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (557b673c-c315-4297-9b04-504dff581155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:37:59 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD Jul 07 08:37:59 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:37:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3e853fa7-25ac-4815-864e-6753ce1e6e39 tempest-CreateVolumesFromSnapshotTest-550584963 None] Created volume successfully. Jul 07 08:37:59 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad" returned: 0 in 1.024s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:37:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:37:59 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad Jul 07 08:37:59 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:00 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD" returned: 0 in 0.903s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:00 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7 1073741824" returned: 0 in 0.942s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:00 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD Jul 07 08:38:00 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:00 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7 Jul 07 08:38:00 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:00 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-7d432a26-d0a7-4486-8d79-12f1476358ad" returned: 0 in 0.740s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-7d432a26-d0a7-4486-8d79-12f1476358ad" released by "delete_volume" :: held 1.803s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created reservations ['7d5ca991-90b3-440e-9cf2-cd2ee3027637', '9f4b922e-ce1a-470a-a559-0c2953bec11e', '17de6c53-f936-4fb3-9083-1c0a996c0874', '52d03df5-85e1-4426-8bf8-67c21d75c4bf'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:00 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:00 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:01 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD" returned: 1 in 0.859s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-2d6a131b-bcee-4f83-b523-5abd537cc347-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] 6a52974f-0060-403f-8751-013b99282005 was raw, converting to raw {{(pid=87179) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:01 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7" returned: 0 in 0.778s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:01 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 Jul 07 08:38:01 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-2d6a131b-bcee-4f83-b523-5abd537cc347-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.025s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1532247468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d2df75-cce7-48cd-8b59-c44542be396b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:54Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Creating volume b4d2df75-cce7-48cd-8b59-c44542be396b {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:01 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:01 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b 1073741824 Jul 07 08:38:01 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e5e857-6f88-4da5-9b4a-ff5ec5ca877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e006c1-acf1-4e31-a199-659a7e17aee7', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22a5a72-d841-410f-9851-3b6aaf2a2069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:01 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.730s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:01 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Deleted volume successfully. Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-quobyte-2d6a131b-bcee-4f83-b523-5abd537cc347" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-2d6a131b-bcee-4f83-b523-5abd537cc347" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2544b6a9-09b0-410a-84c6-573fbf0d0d03]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:01 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume volume-13e006c1-acf1-4e31-a199-659a7e17aee7 (13e006c1-acf1-4e31-a199-659a7e17aee7): created successfully Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22a5a72-d841-410f-9851-3b6aaf2a2069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (e82b20e8-df5d-4f17-b617-4f123c6c53c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=81,cinder:UPDATE=113,cinder:INSERT=33,cinder:DELETE=15 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:38:01 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347 Jul 07 08:38:01 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dae22edc-23ef-4435-8818-a7d9cd65fac7 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-7d432a26-d0a7-4486-8d79-12f1476358ad-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:01 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e98d94ef-4f11-44fa-814a-e610395431a7 tempest-CreateVolumesFromSnapshotTest-550584963 None] Created volume successfully. Jul 07 08:38:02 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888" returned: 0 in 0.848s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6a52974f-0060-403f-8751-013b99282005_g3a2kuzsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:38:02 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:02 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 1G Jul 07 08:38:02 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:02 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b 1073741824" returned: 0 in 0.874s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:02 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347" returned: 0 in 0.869s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:02 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347 Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:02 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:02 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b Jul 07 08:38:02 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:02 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 1G" returned: 0 in 0.721s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a349718-8642-4523-8891-fff295d0bec0]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:02 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 Jul 07 08:38:02 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:03 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-2d6a131b-bcee-4f83-b523-5abd537cc347" returned: 0 in 0.684s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-2d6a131b-bcee-4f83-b523-5abd537cc347" released by "delete_volume" :: held 1.590s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:03 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b" returned: 0 in 0.711s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.511s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505778380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62356656-d4e6-4607-9ed5-ba77c555da91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:54Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Creating volume 62356656-d4e6-4607-9ed5-ba77c555da91 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:03 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:03 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91 1073741824 Jul 07 08:38:03 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a65b829-4ab2-4399-900a-cf09170dfd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d2df75-cce7-48cd-8b59-c44542be396b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbb1e39-2e27-411c-8b13-5e3751636004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:03 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume volume-b4d2df75-cce7-48cd-8b59-c44542be396b (b4d2df75-cce7-48cd-8b59-c44542be396b): created successfully Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbb1e39-2e27-411c-8b13-5e3751636004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (3b931fd6-f12e-4d8a-bc5c-39bfdd3a8a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created reservations ['153250ff-fa3a-4627-9a52-0e8918d7fae7', '661e14c8-ac24-4ef9-a62d-1c4637cb528b', 'dda48b98-5a1f-4ac3-8da9-a9635dedb7e1', '7aff374b-a352-4891-8f6d-be2cc3dfb775'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-fc1f5498-673b-4cd0-ad1f-6021de7255e6 tempest-CreateVolumesFromSnapshotTest-550584963 None] Created volume successfully. Jul 07 08:38:03 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888" returned: 0 in 0.862s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:03 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 Jul 07 08:38:03 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:04 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91 1073741824" returned: 0 in 0.866s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:04 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:04 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:04 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91 Jul 07 08:38:04 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:04 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888" returned: 1 in 0.818s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Downloaded image 6a52974f-0060-403f-8751-013b99282005 ((None, [{'url': 'file:///opt/stack/data/glance/images/6a52974f-0060-403f-8751-013b99282005', 'metadata': {}}])) to volume 78ea1f6a-70eb-4cce-923d-4b2937d4b888 successfully. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Temporary image 6a52974f-0060-403f-8751-013b99282005 for user f2f0c0c0c0cb43ad99285e6e11b456ed is deleted. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Marking volume 78ea1f6a-70eb-4cce-923d-4b2937d4b888 as bootable. {{(pid=87179) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Copying metadata from image 6a52974f-0060-403f-8751-013b99282005 to 78ea1f6a-70eb-4cce-923d-4b2937d4b888. {{(pid=87179) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Creating volume glance metadata for volume 78ea1f6a-70eb-4cce-923d-4b2937d4b888 backed by image 6a52974f-0060-403f-8751-013b99282005 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6a52974f-0060-403f-8751-013b99282005', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7690dd5b48ae2c670bec5b3c757713f2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87179) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:38:04 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:04 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:04 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:04 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Deleted volume successfully. Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-aed0ee82-c346-4f54-a6f8-73bbd27c586b-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-7098a770-04cb-44d6-94c1-4a51faf0f17e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-2d6a131b-bcee-4f83-b523-5abd537cc347-delete_volume" released by "delete_volume" :: held 3.651s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-aed0ee82-c346-4f54-a6f8-73bbd27c586b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8135822d-c4da-44f4-b47e-154f2f6ce128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888', 'volume_size': 1, 'image_id': '6a52974f-0060-403f-8751-013b99282005', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a52974f-0060-403f-8751-013b99282005', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7690dd5b48ae2c670bec5b3c757713f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ba44933193a745c6a2e15202d714ee9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0f33cea55b02baae54ec3fddc7c9086da09cf464d6b1fd02e5d4ff500719fae7a94b8c9f70644ddfbecedae833706cddf60e0cf54684912ff838d2d58ab0ee6a', 'id': '6a52974f-0060-403f-8751-013b99282005', 'created_at': datetime.datetime(2026, 7, 7, 6, 37, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 37, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a52974f-0060-403f-8751-013b99282005/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f07db5-e48c-445f-bc50-e8effad6bfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:04 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Volume volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 (78ea1f6a-70eb-4cce-923d-4b2937d4b888): created successfully Jul 07 08:38:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f07db5-e48c-445f-bc50-e8effad6bfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Flow 'volume_create_manager' (97e751c1-d445-483d-9471-17f1a7209075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-quobyte-aed0ee82-c346-4f54-a6f8-73bbd27c586b" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-aed0ee82-c346-4f54-a6f8-73bbd27c586b" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c289d-5952-4567-bd81-6ea0ac25d450]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:05 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-62b8af5d-dce7-46b7-b0bd-968d724d5e23 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Created volume successfully. Jul 07 08:38:05 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91" returned: 0 in 0.753s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.927s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922026308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ce1fce-78b0-4e69-bab7-c5c833bf6b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b9127a3c694bbba5b81a01ffa4904b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:37:55Z,use_quota=True,user_id='890ced428ce84d86a4d9f29945933282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Creating volume 22ce1fce-78b0-4e69-bab7-c5c833bf6b9c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:05 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:05 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c 1073741824 Jul 07 08:38:05 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355eca71-c1bf-422c-9f12-d238fcf12b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62356656-d4e6-4607-9ed5-ba77c555da91', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a58e2d-3b22-4488-ba90-f10866a6f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:05 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b Jul 07 08:38:05 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:05 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume volume-62356656-d4e6-4607-9ed5-ba77c555da91 (62356656-d4e6-4607-9ed5-ba77c555da91): created successfully Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a58e2d-3b22-4488-ba90-f10866a6f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (c7bf67f3-184d-4038-a4f7-647c727907c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:05 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d69bc815-ea28-4902-9d17-62c03a5b7aaa tempest-CreateVolumesFromSnapshotTest-550584963 None] Created volume successfully. Jul 07 08:38:05 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Acquiring lock "cinder-78ea1f6a-70eb-4cce-923d-4b2937d4b888-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.876s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "cinder-78ea1f6a-70eb-4cce-923d-4b2937d4b888-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Acquiring lock "cinder-quobyte-78ea1f6a-70eb-4cce-923d-4b2937d4b888" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "cinder-quobyte-78ea1f6a-70eb-4cce-923d-4b2937d4b888" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[df535b79-a256-4a08-8714-bef42d05364b]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:05 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 Jul 07 08:38:05 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:05 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b" returned: 0 in 0.895s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:06 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b Jul 07 08:38:06 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:06 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c 1073741824" returned: 0 in 1.083s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:06 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c Jul 07 08:38:06 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:06 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888" returned: 0 in 0.837s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:06 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 Jul 07 08:38:06 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:06 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-aed0ee82-c346-4f54-a6f8-73bbd27c586b" returned: 0 in 0.819s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-aed0ee82-c346-4f54-a6f8-73bbd27c586b" released by "delete_volume" :: held 1.771s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created reservations ['dae85e8d-d14e-45dd-a8ae-5016b3bdae8a', '404ed0a4-bb59-4a77-a5fb-246ee9a63644', '184d992e-d363-4a69-bd9c-3bf05c9df613', 'd5802ab8-afc9-40f0-acd9-0cfcd54d453a'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:06 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:06 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-3a12882a-fd9d-4dce-b56f-3be12c5a0fad-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-3a12882a-fd9d-4dce-b56f-3be12c5a0fad-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-quobyte-3a12882a-fd9d-4dce-b56f-3be12c5a0fad" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-3a12882a-fd9d-4dce-b56f-3be12c5a0fad" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:07 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c" returned: 0 in 0.871s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9454924b-9914-44c1-98c2-cebf61835cea]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1b6766-1e62-4ab6-ba0a-fdfeff28f165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677d6456-7c2c-4ab2-ba45-12e5d481ea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:07 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Volume volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c (22ce1fce-78b0-4e69-bab7-c5c833bf6b9c): created successfully Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677d6456-7c2c-4ab2-ba45-12e5d481ea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Flow 'volume_create_manager' (0cf5b679-8a41-4371-8989-6a3fc486f6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3ce94bcd-b94d-4d3c-a7fd-72baee9e9413 tempest-CreateVolumesFromSnapshotTest-550584963 None] Created volume successfully. Jul 07 08:38:07 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad Jul 07 08:38:07 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:07 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888" returned: 1 in 0.882s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:07 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888 Jul 07 08:38:07 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:07 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.760s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:07 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Deleted volume successfully. Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b4f8b281-6c37-4608-8005-8b7fe4eb0a8e tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-aed0ee82-c346-4f54-a6f8-73bbd27c586b-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:07 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-quobyte-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c" acquired by "delete_volume" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32927bb-abf2-4a25-9d0e-8bfd23152380]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:08 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c Jul 07 08:38:08 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:08 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad" returned: 0 in 0.981s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:08 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad Jul 07 08:38:08 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:08 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-78ea1f6a-70eb-4cce-923d-4b2937d4b888" returned: 0 in 0.948s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "cinder-quobyte-78ea1f6a-70eb-4cce-923d-4b2937d4b888" released by "delete_volume" :: held 2.737s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Created reservations ['68a41b6c-a9a8-4e40-8b42-2f357a1d823c', '2b0f96dc-d2ea-4703-9c60-af0ef7e53553', 'a55ff0ff-552d-4282-a902-e28e31a7b81f', 'ea5dec8c-e8b0-44a2-b298-275e3bb3f18d'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:08 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:08 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:09 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3a12882a-fd9d-4dce-b56f-3be12c5a0fad" returned: 0 in 0.797s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:09 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c" returned: 0 in 1.024s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-3a12882a-fd9d-4dce-b56f-3be12c5a0fad" released by "delete_volume" :: held 1.862s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:09 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c Jul 07 08:38:09 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created reservations ['7267667e-8ac6-4d3a-8054-4364ab9cf134', '051d6126-9832-43ac-95e7-a9721bfbd0aa', 'f9269926-a44c-496b-a46e-190e0709fdfb', '24aa8e7a-649a-4633-9f5b-6bdea20e2eff'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:09 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:09 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "cinder-quobyte-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:09 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.133s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:09 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Deleted volume successfully. Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de51b05-32d0-4ae6-a1e4-f846d4a53589]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-edfe5d0f-7411-4456-9e0f-feaca1dbee07 tempest-VolumeAndVolumeTypeFromImageTest-1626487584 None] Lock "cinder-78ea1f6a-70eb-4cce-923d-4b2937d4b888-delete_volume" released by "delete_volume" :: held 4.285s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:09 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca Jul 07 08:38:09 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:10 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c" returned: 0 in 1.126s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c" released by "delete_volume" :: held 2.216s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Created reservations ['8b24858b-5141-40eb-88ed-fe67844e3909', '7ef43dd2-a81b-46e1-8049-0411d55f5e67', '7e0fda78-e7e2-4f30-b8a0-25574ca7f122', '6291be3e-1f29-4245-a949-83ea016cd369'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:10 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.022s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Deleted volume successfully. Jul 07 08:38:10 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:10 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4c0eb1f2-771c-4c31-b0da-c757ece21b4b tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-3a12882a-fd9d-4dce-b56f-3be12c5a0fad-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:10 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca" returned: 0 in 1.135s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:10 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca Jul 07 08:38:10 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:11 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.919s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:11 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Deleted volume successfully. Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-c19bf31e-2006-47b1-9334-1cb7cc0682ce tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-22ce1fce-78b0-4e69-bab7-c5c833bf6b9c-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-62356656-d4e6-4607-9ed5-ba77c555da91-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-62356656-d4e6-4607-9ed5-ba77c555da91-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-quobyte-62356656-d4e6-4607-9ed5-ba77c555da91" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-62356656-d4e6-4607-9ed5-ba77c555da91" acquired by "delete_volume" :: waited 0.031s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb5cfc4-55fc-4691-b8f4-eff4193a6198]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:11 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91 Jul 07 08:38:11 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:11 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca" returned: 0 in 0.959s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-quobyte-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca" released by "delete_volume" :: held 2.181s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:11 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Created reservations ['72907396-40fb-4279-91fb-87d55b453ee5', '446f3054-499d-471c-a13b-fd9365aff878', 'cc2d289f-46b3-412f-885e-5c0f88e8a1c4', '6be2b714-63e1-46fb-a7d5-ca74d78d7eef'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:12 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:12 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:12 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91" returned: 0 in 1.030s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:12 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91 Jul 07 08:38:12 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:13 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.994s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Deleted volume successfully. Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-0afb3be7-9258-4c6d-8196-684ddfe0c755 tempest-CreateVolumesFromSourceVolumeTest-978230719 None] Lock "cinder-54a9b80a-a8bd-4dd2-83a8-8e686e8bfcca-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:13 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-62356656-d4e6-4607-9ed5-ba77c555da91" returned: 0 in 0.960s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-62356656-d4e6-4607-9ed5-ba77c555da91" released by "delete_volume" :: held 2.065s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Created reservations ['4f868750-b6f0-45f2-bc70-77c83ec2acab', '48f2cdf5-3c44-4145-af7c-e9b8e841c817', '925c3971-dd8b-4e4b-b74a-2ca2352bd4a3', '4b77388f-f4de-4ea4-b557-3201566c3b13'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:13 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:13 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:14 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.897s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:14 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Deleted volume successfully. Jul 07 08:38:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5ac92725-2a30-4a01-a8e9-41d54e212de8 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-62356656-d4e6-4607-9ed5-ba77c555da91-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:14 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-b4d2df75-cce7-48cd-8b59-c44542be396b-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-b4d2df75-cce7-48cd-8b59-c44542be396b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-quobyte-b4d2df75-cce7-48cd-8b59-c44542be396b" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-b4d2df75-cce7-48cd-8b59-c44542be396b" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd397c8-b448-4ff7-9bad-3998028cb91d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:15 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b Jul 07 08:38:15 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Flow 'volume_create_manager' (5a015eda-696c-4eb9-97ba-48f0076ca6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4732e064-561c-49b4-88f0-bb4206bc9bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4732e064-561c-49b4-88f0-bb4206bc9bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03addc628e954736a2f589e36266eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:15Z,use_quota=True,user_id='8609eac1b9ca466abe577b9215d39ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f53520-3dc7-426c-8c36-2e5c67d4ae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f53520-3dc7-426c-8c36-2e5c67d4ae46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35ac6a-9f28-47c8-a00c-0a34fd000442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35ac6a-9f28-47c8-a00c-0a34fd000442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e45186-f0a5-4ad6-8f96-fb3b5d5b8065', 'volume_name': 'volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a948fc84-b4bd-4c33-a639-eba0e4bd2671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a948fc84-b4bd-4c33-a639-eba0e4bd2671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c16bbc-6630-4bba-a86a-3724b1328f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:15 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Volume d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065', 'volume_size': 1} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03addc628e954736a2f589e36266eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:15Z,use_quota=True,user_id='8609eac1b9ca466abe577b9215d39ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Creating volume d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:15 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:15 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 1073741824 Jul 07 08:38:15 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:16 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b" returned: 0 in 0.964s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:16 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b Jul 07 08:38:16 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:16 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 1073741824" returned: 0 in 1.050s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:16 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 Jul 07 08:38:16 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:16 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-b4d2df75-cce7-48cd-8b59-c44542be396b" returned: 0 in 0.791s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-b4d2df75-cce7-48cd-8b59-c44542be396b" released by "delete_volume" :: held 1.814s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:16 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Created reservations ['7a4b5d85-cbee-4f81-8b62-f92683b31874', 'c6a376bd-d46c-4ffc-87e7-95b4cdc9f16b', 'bccca0e1-d7e9-460e-9846-966c3676f6c7', '55a38d20-ad0c-46fd-a52c-ff666d28fe11'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:17 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:17 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Flow 'volume_create_manager' (a1cbca69-e2a1-4b3d-a6f0-022a318c754d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd34d728-dae6-4a3a-a711-e155573182c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-13e006c1-acf1-4e31-a199-659a7e17aee7-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd34d728-dae6-4a3a-a711-e155573182c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-369456844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373fe7e3-c43c-45e4-b5e1-3c779e5bcb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b54a7e4c5344c3faf0fd7134f4a62f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:17Z,use_quota=True,user_id='8e8578cb9ea9453a91aa7c444af3aa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f448e99-b443-4aa7-8267-f570566f70f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f448e99-b443-4aa7-8267-f570566f70f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:17 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0730de1-c177-4759-9024-620a28f9d44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0730de1-c177-4759-9024-620a28f9d44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373fe7e3-c43c-45e4-b5e1-3c779e5bcb83', 'volume_name': 'volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb48db5-78cd-4398-91d5-514e2cfb452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb48db5-78cd-4398-91d5-514e2cfb452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802c4e6d-137f-4757-aff4-ee44d68056f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:17 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Volume 373fe7e3-c43c-45e4-b5e1-3c779e5bcb83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83', 'volume_size': 1} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065" returned: 0 in 0.947s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-369456844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373fe7e3-c43c-45e4-b5e1-3c779e5bcb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b54a7e4c5344c3faf0fd7134f4a62f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:17Z,use_quota=True,user_id='8e8578cb9ea9453a91aa7c444af3aa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Creating volume 373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:17 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c16bbc-6630-4bba-a86a-3724b1328f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bccba6-5b27-42b8-a1c3-4cb264decf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-13e006c1-acf1-4e31-a199-659a7e17aee7-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:17 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 1073741824 Jul 07 08:38:17 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:17 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Volume volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 (d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065): created successfully Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bccba6-5b27-42b8-a1c3-4cb264decf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Flow 'volume_create_manager' (5a015eda-696c-4eb9-97ba-48f0076ca6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-quobyte-13e006c1-acf1-4e31-a199-659a7e17aee7" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:17 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-118d8847-bc5b-46c5-bccc-9f6c1a0b27bf tempest-CinderUnicodeTest-1848003285 None] Created volume successfully. Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-13e006c1-acf1-4e31-a199-659a7e17aee7" acquired by "delete_volume" :: waited 0.040s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e4a20-e3d3-4c60-bd4d-b136b61f0bb0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:17 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:17 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7 Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.898s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:17 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:17 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:17 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Deleted volume successfully. Jul 07 08:38:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d66830db-6ed5-4167-8dc5-2a6873d18c29 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-b4d2df75-cce7-48cd-8b59-c44542be396b-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:18 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7" returned: 0 in 0.849s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:18 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 1073741824" returned: 0 in 1.091s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:18 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7 Jul 07 08:38:18 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:18 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 Jul 07 08:38:18 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Flow 'volume_create_manager' (2595b408-51a2-489f-a732-608eae1d51f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b856cf7-3072-4e9f-ba28-9b40ddce23eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b856cf7-3072-4e9f-ba28-9b40ddce23eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1564542584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03addc628e954736a2f589e36266eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:19Z,use_quota=True,user_id='8609eac1b9ca466abe577b9215d39ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1df6630-00ab-4173-b165-0125ff8f4474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1df6630-00ab-4173-b165-0125ff8f4474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed876d76-fc8c-4bd2-ac0c-70daefd1219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed876d76-fc8c-4bd2-ac0c-70daefd1219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452', 'volume_name': 'volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba02724b-0f28-444c-bb62-fa4d82292ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba02724b-0f28-444c-bb62-fa4d82292ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7396e8-668d-40a1-b7ca-031359fc53dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:19 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Volume a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452', 'volume_size': 1} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:19 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-13e006c1-acf1-4e31-a199-659a7e17aee7" returned: 0 in 0.854s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:19 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" returned: 0 in 0.767s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-13e006c1-acf1-4e31-a199-659a7e17aee7" released by "delete_volume" :: held 1.755s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.101s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1564542584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03addc628e954736a2f589e36266eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:19Z,use_quota=True,user_id='8609eac1b9ca466abe577b9215d39ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Creating volume a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:19 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:19 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 1073741824 Jul 07 08:38:19 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802c4e6d-137f-4757-aff4-ee44d68056f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193885b9-008b-4d01-90b7-0e54f6e5b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:19 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Volume volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 (373fe7e3-c43c-45e4-b5e1-3c779e5bcb83): created successfully Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193885b9-008b-4d01-90b7-0e54f6e5b056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Flow 'volume_create_manager' (a1cbca69-e2a1-4b3d-a6f0-022a318c754d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:19 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-15c080b9-a312-4b02-81d4-0f6b4e613420 tempest-VolumeDependencyTests-1371488851 None] Created volume successfully. Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Created reservations ['52efa463-55db-4d9d-918f-a26b8eef99d9', '3800e018-5ad8-45ab-9560-94ba567f5c53', '1fe4a874-ee4f-4db8-bdac-8fb70fc066b7', 'db197447-8180-4c52-890b-c9a0c4dff3ba'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:19 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:19 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Flow 'volume_create_manager' (af980585-d0a0-43e3-a6f5-d7e7da1abf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43307dc-58c5-41f8-920e-51201c30747b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43307dc-58c5-41f8-920e-51201c30747b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729553885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4babe1b1-fd1e-4a36-8267-d66fa2f63b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0371597f701f41e4acf4d6a7fe63ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:20Z,use_quota=True,user_id='a9e07507b2b94246807dc15aa9228ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc77f3b-ff3e-42ce-835e-bda70a10cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc77f3b-ff3e-42ce-835e-bda70a10cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:20 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8cc62d-9961-4701-bbe4-dfd5f64c064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8cc62d-9961-4701-bbe4-dfd5f64c064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4babe1b1-fd1e-4a36-8267-d66fa2f63b5d', 'volume_name': 'volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0173525e-a337-451b-b209-c15826756e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0173525e-a337-451b-b209-c15826756e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21896378-6d23-41c7-a0fc-bf24f45fd9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:20 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Volume 4babe1b1-fd1e-4a36-8267-d66fa2f63b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d', 'volume_size': 1} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.712s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:20 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:20 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Deleted volume successfully. Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 1073741824" returned: 0 in 0.941s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e7693291-22e2-4efe-b59d-e48b93428efe tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-13e006c1-acf1-4e31-a199-659a7e17aee7-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:20 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 Jul 07 08:38:20 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-03b64c7b-f877-4754-9edd-42179baeecd7-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-03b64c7b-f877-4754-9edd-42179baeecd7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-quobyte-03b64c7b-f877-4754-9edd-42179baeecd7" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-03b64c7b-f877-4754-9edd-42179baeecd7" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e399fb-0ed6-4303-a5a9-a1134accd0d4]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:21 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7 Jul 07 08:38:21 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:21 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" returned: 0 in 0.646s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729553885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4babe1b1-fd1e-4a36-8267-d66fa2f63b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0371597f701f41e4acf4d6a7fe63ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:20Z,use_quota=True,user_id='a9e07507b2b94246807dc15aa9228ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Creating volume 4babe1b1-fd1e-4a36-8267-d66fa2f63b5d {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:21 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7396e8-668d-40a1-b7ca-031359fc53dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:21 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d 1073741824 Jul 07 08:38:21 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14f37b8-5b9c-4f6f-8b50-99d099a626de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:21 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Volume volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 (a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452): created successfully Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14f37b8-5b9c-4f6f-8b50-99d099a626de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Flow 'volume_create_manager' (2595b408-51a2-489f-a732-608eae1d51f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:21 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-500f57fc-2686-416c-8766-2753cdc2ac5b tempest-CinderUnicodeTest-1848003285 None] Created volume successfully. Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:21 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7" returned: 0 in 0.819s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:21 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7 Jul 07 08:38:21 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:22 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d 1073741824" returned: 0 in 0.902s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:22 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d Jul 07 08:38:22 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:22 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-03b64c7b-f877-4754-9edd-42179baeecd7" returned: 0 in 0.642s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-03b64c7b-f877-4754-9edd-42179baeecd7" released by "delete_volume" :: held 1.512s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Created reservations ['c1b7c4be-f980-4e1d-97c4-381c6eb987ab', '3cda8839-0d6b-4993-b42a-b747c3abf8dc', 'e98f7122-ef81-4327-9254-fc3701f201cd', '24f065c9-3add-4c26-af94-de7bc628d498'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:22 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:22 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:22 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d" returned: 0 in 0.642s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.060s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21896378-6d23-41c7-a0fc-bf24f45fd9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6c9427-b6e6-431d-b260-e10f1c960bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Creating offline snapshot db5e86bf-6675-4eb0-abe0-bcc792c606c7 of volume 373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:38:22 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Volume volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d (4babe1b1-fd1e-4a36-8267-d66fa2f63b5d): created successfully Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6c9427-b6e6-431d-b260-e10f1c960bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Flow 'volume_create_manager' (af980585-d0a0-43e3-a6f5-d7e7da1abf99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cdffe1-7898-432f-8baf-21b3683eb800]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-056e0e78-9d6d-4cc8-8193-f30b25c5ebb0 tempest-ProjectReaderTests-1717937901 None] Created volume successfully. Jul 07 08:38:23 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 Jul 07 08:38:23 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-0c6d0c64-b9ca-462b-b280-35ae82dafcfe-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-0c6d0c64-b9ca-462b-b280-35ae82dafcfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-quobyte-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-quobyte-0c6d0c64-b9ca-462b-b280-35ae82dafcfe" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-0c6d0c64-b9ca-462b-b280-35ae82dafcfe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Deleting offline snapshot 0c6d0c64-b9ca-462b-b280-35ae82dafcfe of volume 988a2549-6132-47ec-8bcc-c4e4b87fcc7f {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] snapshot_file for this snap is: volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[51173b73-5642-4349-969e-c62f5d41174c]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:23 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe Jul 07 08:38:23 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:23 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.747s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:23 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Deleted volume successfully. Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-764266ba-9f96-4b0b-9d96-7e70b6b91cde tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-03b64c7b-f877-4754-9edd-42179baeecd7-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:23 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" returned: 0 in 0.792s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:23 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 1G Jul 07 08:38:23 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Acquiring lock "cinder-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Lock "cinder-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Acquiring lock "cinder-quobyte-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Lock "cinder-quobyte-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2828fc01-502b-4f0d-86b4-5c881d98622f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:24 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d Jul 07 08:38:24 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:24 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe" returned: 0 in 0.818s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a1d6af-f834-4547-9c01-0b236fdfac2f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:24 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f Jul 07 08:38:24 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:24 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 1G" returned: 0 in 0.837s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:24 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 Jul 07 08:38:24 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:24 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d" returned: 0 in 0.800s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:24 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d Jul 07 08:38:24 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:24 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" returned: 0 in 0.914s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:25 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe Jul 07 08:38:25 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:25 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7" returned: 0 in 0.715s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:25 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 is being set with open permissions: ugo+rw Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:25 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 Jul 07 08:38:25 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:25 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d" returned: 0 in 0.703s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Lock "cinder-quobyte-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d" released by "delete_volume" :: held 1.546s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Created reservations ['40b0d94e-c60f-4e22-99e3-d8198669fc73', '5ce9bb11-5c78-4d84-b884-3b7b92e7ea38', 'd4978be9-c524-4b36-ae6e-8c8b89139e3c', '39823093-aaaa-4bf1-b056-f4701895e74c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:25 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:25 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:25 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe" returned: 0 in 0.810s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:25 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe Jul 07 08:38:25 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:25 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7" returned: 0 in 0.681s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:26 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.info Jul 07 08:38:26 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:26 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.808s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Deleted volume successfully. Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-70482055-b7ab-43d1-a7e6-70ec4666022a tempest-ProjectReaderTests-1717937901 None] Lock "cinder-4babe1b1-fd1e-4a36-8267-d66fa2f63b5d-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:26 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f.0c6d0c64-b9ca-462b-b280-35ae82dafcfe" returned: 0 in 0.704s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-0c6d0c64-b9ca-462b-b280-35ae82dafcfe" released by "_delete_snapshot" :: held 3.370s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" released by "delete_snapshot" :: held 3.394s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Flow 'volume_create_manager' (f6c6020f-cedb-4027-9458-d3b6a8676bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637aac8f-facf-49ea-ac2d-a8b9719ab92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Created reservations ['98b9a8f2-cacc-4fd9-9c9a-e889428ea95a', '11964e1c-c996-4302-82b4-12cc4ee4f245', 'cf5bab90-cab9-4ed5-98b6-bbb4a10e6043', '37ace567-7c9e-4455-8870-c904b9fba7eb'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637aac8f-facf-49ea-ac2d-a8b9719ab92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671849081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb17daf5-f2f4-4142-9799-59c01900f949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0371597f701f41e4acf4d6a7fe63ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:27Z,use_quota=True,user_id='a9e07507b2b94246807dc15aa9228ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3f864e-2a5f-4788-b599-044f9978ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3f864e-2a5f-4788-b599-044f9978ead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29be1d8a-cddc-4d95-a06d-8418e858b8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29be1d8a-cddc-4d95-a06d-8418e858b8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb17daf5-f2f4-4142-9799-59c01900f949', 'volume_name': 'volume-cb17daf5-f2f4-4142-9799-59c01900f949', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34098b8-493a-4c94-b26a-ffea30a13395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34098b8-493a-4c94-b26a-ffea30a13395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce02529e-8e00-4c23-9545-13b169b5d065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:26 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Volume cb17daf5-f2f4-4142-9799-59c01900f949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb17daf5-f2f4-4142-9799-59c01900f949', 'volume_size': 1} Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:26 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.info" returned: 0 in 0.749s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:26 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.info is being set with open permissions: ugo+rw Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:26 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.info Jul 07 08:38:26 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:26 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Delete snapshot completed successfully. Jul 07 08:38:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-242c8dd9-b523-44c4-a1bd-4c9da3644aa0 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-0c6d0c64-b9ca-462b-b280-35ae82dafcfe-delete_snapshot" released by "delete_snapshot" :: held 3.654s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:27 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-988a2549-6132-47ec-8bcc-c4e4b87fcc7f-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.info" returned: 0 in 0.611s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.536s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.652s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-988a2549-6132-47ec-8bcc-c4e4b87fcc7f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Creating offline snapshot fae1a79c-76dc-4511-a26d-a2954d4d6904 of volume a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:38:27 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d6b3282a-60b0-46e0-ad45-9722a60e9055 tempest-VolumeDependencyTests-1371488851 None] Create snapshot completed successfully Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e414e8a-53f5-4ec0-844c-f150c441bb23]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "cinder-quobyte-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b1d5b9-cc59-4e03-8b1f-ef144c2144fd]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:27 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 Jul 07 08:38:27 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:27 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f Jul 07 08:38:27 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:28 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" returned: 0 in 0.773s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:28 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 1G Jul 07 08:38:28 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:28 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" returned: 0 in 0.830s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:28 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f Jul 07 08:38:28 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=218,cinder:SELECT=174,cinder:INSERT=52,cinder:DELETE=21 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Flow 'volume_create_manager' (28f0b8d8-e095-48d0-b461-f322dda5e325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f23b24f-2dc9-48c5-bfa5-3cd7d50a89e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f23b24f-2dc9-48c5-bfa5-3cd7d50a89e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2018903977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac524246-ab49-4465-bb85-dacbb6948c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b54a7e4c5344c3faf0fd7134f4a62f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db5e86bf-6675-4eb0-abe0-bcc792c606c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:29Z,use_quota=True,user_id='8e8578cb9ea9453a91aa7c444af3aa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912225ff-37df-4dfe-b3ba-0fadc1705c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912225ff-37df-4dfe-b3ba-0fadc1705c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e16ab1-548d-4cd9-be8a-8e0f6f8a8cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e16ab1-548d-4cd9-be8a-8e0f6f8a8cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac524246-ab49-4465-bb85-dacbb6948c10', 'volume_name': 'volume-ac524246-ab49-4465-bb85-dacbb6948c10', 'volume_size': 1, 'snapshot_id': 'db5e86bf-6675-4eb0-abe0-bcc792c606c7'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b00956-939e-47ff-9682-a15ed624ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b00956-939e-47ff-9682-a15ed624ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209fb9c0-7c18-48ce-95d5-ad40ad749e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:28 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Volume ac524246-ab49-4465-bb85-dacbb6948c10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac524246-ab49-4465-bb85-dacbb6948c10', 'volume_size': 1, 'snapshot_id': 'db5e86bf-6675-4eb0-abe0-bcc792c606c7'} Jul 07 08:38:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:29 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:29 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 1G" returned: 0 in 0.849s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" returned: 0 in 0.710s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:29 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 Jul 07 08:38:29 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-quobyte-988a2549-6132-47ec-8bcc-c4e4b87fcc7f" released by "delete_volume" :: held 1.612s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Created reservations ['60a9ecd7-34ff-47e9-ae1e-1c5bc4ef5f35', 'd0dc2fcf-fa14-4a61-911a-47d853e62cec', '9ce0da4f-ce10-4e72-bac2-8a7cbcc6c3be', 'ff56f704-47dd-4b65-bf26-09429ca46151'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:29 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:29 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:29 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904" returned: 0 in 0.703s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:29 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 is being set with open permissions: ugo+rw Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:29 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 Jul 07 08:38:29 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:29 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.724s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Deleted volume successfully. Jul 07 08:38:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-ee788c57-29d1-40b2-a63d-dca62d4d2105 tempest-CreateVolumesFromSnapshotTest-550584963 None] Lock "cinder-988a2549-6132-47ec-8bcc-c4e4b87fcc7f-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:30 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904" returned: 0 in 0.677s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:30 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.info Jul 07 08:38:30 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:31 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.info" returned: 0 in 0.760s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:31 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.info is being set with open permissions: ugo+rw Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:31 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.info Jul 07 08:38:31 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:31 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.info" returned: 0 in 0.664s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.536s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.195s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671849081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb17daf5-f2f4-4142-9799-59c01900f949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0371597f701f41e4acf4d6a7fe63ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:27Z,use_quota=True,user_id='a9e07507b2b94246807dc15aa9228ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Creating volume cb17daf5-f2f4-4142-9799-59c01900f949 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:31 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:31 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949 1073741824 Jul 07 08:38:31 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-82e42319-7cee-45a7-b605-94bb332d0674 tempest-CinderUnicodeTest-1848003285 None] Create snapshot completed successfully Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "cinder-fae1a79c-76dc-4511-a26d-a2954d4d6904-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-fae1a79c-76dc-4511-a26d-a2954d4d6904-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "cinder-quobyte-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-quobyte-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "cinder-quobyte-fae1a79c-76dc-4511-a26d-a2954d4d6904" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-quobyte-fae1a79c-76dc-4511-a26d-a2954d4d6904" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Deleting offline snapshot fae1a79c-76dc-4511-a26d-a2954d4d6904 of volume a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] snapshot_file for this snap is: volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b39bcac-1d7f-46ce-b923-f9dfc69b88f0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:32 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 Jul 07 08:38:32 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:32 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949 1073741824" returned: 0 in 1.058s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:33 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949 Jul 07 08:38:33 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:33 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904" returned: 0 in 0.875s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedcd558-23b3-4355-820f-ab897d89fa92]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:33 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 Jul 07 08:38:33 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:33 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949" returned: 0 in 0.706s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.865s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "cinder-quobyte-db5e86bf-6675-4eb0-abe0-bcc792c606c7-ac524246-ab49-4465-bb85-dacbb6948c10" by "_create_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce02529e-8e00-4c23-9545-13b169b5d065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb17daf5-f2f4-4142-9799-59c01900f949', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bc0692-5c73-484d-86dd-80f1f1efa243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-db5e86bf-6675-4eb0-abe0-bcc792c606c7-ac524246-ab49-4465-bb85-dacbb6948c10" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Creating volume ac524246-ab49-4465-bb85-dacbb6948c10 from snapshot db5e86bf-6675-4eb0-abe0-bcc792c606c7 {{(pid=87179) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "cinder-quobyte-ac524246-ab49-4465-bb85-dacbb6948c10" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-ac524246-ab49-4465-bb85-dacbb6948c10" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] snapshot: db5e86bf-6675-4eb0-abe0-bcc792c606c7, volume: ac524246-ab49-4465-bb85-dacbb6948c10, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:38:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Volume volume-cb17daf5-f2f4-4142-9799-59c01900f949 (cb17daf5-f2f4-4142-9799-59c01900f949): created successfully Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bc0692-5c73-484d-86dd-80f1f1efa243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Flow 'volume_create_manager' (f6c6020f-cedb-4027-9458-d3b6a8676bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-39db07eb-cf12-4f9a-a593-28f472b8e66b tempest-ProjectReaderTests-1717937901 None] Created volume successfully. Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[986bfbfc-b4f7-4661-9543-b9593cf62566]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:34 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" returned: 0 in 0.862s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:34 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 Jul 07 08:38:34 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:34 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 Jul 07 08:38:34 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "cinder-cb17daf5-f2f4-4142-9799-59c01900f949-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Lock "cinder-cb17daf5-f2f4-4142-9799-59c01900f949-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "cinder-quobyte-cb17daf5-f2f4-4142-9799-59c01900f949" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Lock "cinder-quobyte-cb17daf5-f2f4-4142-9799-59c01900f949" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e453efc-00cf-4f37-a315-fd0d8a8b6159]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:34 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949 Jul 07 08:38:34 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:34 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7" returned: 0 in 0.856s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf3a589-dab4-434a-b167-0eeeed12d511]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:34 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 Jul 07 08:38:34 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:34 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904" returned: 0 in 0.959s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:35 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904 Jul 07 08:38:35 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:35 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949" returned: 0 in 1.031s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:35 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949 Jul 07 08:38:35 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Flow 'volume_create_manager' (4361f952-9d82-47a8-b995-27533c2dd635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7305c17-b3b8-4b33-a97d-a2171060a9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7305c17-b3b8-4b33-a97d-a2171060a9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957ff918-4a3c-49ff-ad43-d55169756d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7922cbfcaa4d10b6743afb04d49650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:36Z,use_quota=True,user_id='7d842b7f84ef4e65b39df0c0f56a4bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de9f758-adf0-497f-b961-e35136481e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de9f758-adf0-497f-b961-e35136481e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b5c3c2-77dd-4da4-8369-727df714a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.image.glance [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Creating Keystone auth plugin from conf {{(pid=87179) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 08:38:35 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:35 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452.fae1a79c-76dc-4511-a26d-a2954d4d6904" returned: 0 in 0.829s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" returned: 0 in 1.038s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:35 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 Jul 07 08:38:35 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-quobyte-fae1a79c-76dc-4511-a26d-a2954d4d6904" released by "_delete_snapshot" :: held 3.678s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b5c3c2-77dd-4da4-8369-727df714a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '957ff918-4a3c-49ff-ad43-d55169756d97', 'volume_name': 'volume-957ff918-4a3c-49ff-ad43-d55169756d97', 'volume_size': 1, 'image_id': '252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2217fbe93b9f617b8182e8cc7d0a7f92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e7922cbfcaa4d10b6743afb04d49650', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15ed9297f7a5e107c6450254a5c469abbd5f9e77891eedae01146f853b59b7d18c07d29a723b2e8bcb99efaa07f7109d56f9bf5d2126ae2f3f7ba48462ece782', 'id': '252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'created_at': datetime.datetime(2026, 7, 7, 6, 38, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 38, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/252c889c-268d-4f82-aa92-b8f4e9b51a5c/file', 'properties': {}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4bec36-fabe-4c2b-99b4-02ae5a14ce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4bec36-fabe-4c2b-99b4-02ae5a14ce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64772616-256d-4b01-a290-85bf7e1750f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Volume 957ff918-4a3c-49ff-ad43-d55169756d97: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-957ff918-4a3c-49ff-ad43-d55169756d97', 'volume_size': 1, 'image_id': '252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2217fbe93b9f617b8182e8cc7d0a7f92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e7922cbfcaa4d10b6743afb04d49650', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15ed9297f7a5e107c6450254a5c469abbd5f9e77891eedae01146f853b59b7d18c07d29a723b2e8bcb99efaa07f7109d56f9bf5d2126ae2f3f7ba48462ece782', 'id': '252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'created_at': datetime.datetime(2026, 7, 7, 6, 38, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 38, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/252c889c-268d-4f82-aa92-b8f4e9b51a5c/file', 'properties': {}}, 'image_service': } Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Trying to clone 957ff918-4a3c-49ff-ad43-d55169756d97 from image 252c889c-268d-4f82-aa92-b8f4e9b51a5c at location (None, [{'url': 'file:///opt/stack/data/glance/images/252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'metadata': {}}]). {{(pid=87179) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 08:38:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-quobyte-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" released by "delete_snapshot" :: held 3.744s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Created reservations ['6cbfa456-50aa-4dcb-af57-bd01f3b1a2f7', '79479602-52ff-4419-818a-b653e61454e4', 'c49541a6-0401-41e3-8e20-d14ece12adac', '5eb8c2b6-e267-46cc-9fde-1da5159d702c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 08:38:36 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Image download 0.00 MB at 0.00 MB/s Jul 07 08:38:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Delete snapshot completed successfully. Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-55c1b3ec-eb87-4ed9-9561-846bdb604bda tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-fae1a79c-76dc-4511-a26d-a2954d4d6904-delete_snapshot" released by "delete_snapshot" :: held 3.931s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c44499-ddb1-4f0b-976a-9a6db51d4a14]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:36 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-cb17daf5-f2f4-4142-9799-59c01900f949" returned: 0 in 0.826s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Lock "cinder-quobyte-cb17daf5-f2f4-4142-9799-59c01900f949" released by "delete_volume" :: held 1.919s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:36 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD Jul 07 08:38:36 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Created reservations ['a7925e6f-bd2f-4a3c-859a-059f37085c79', 'e13df885-d8ec-4a85-8eff-c36c3f4a486e', '49c42f6f-037d-4cb2-a69d-fd32763f8735', '77292e9a-c7ac-43f0-bdf2-d3f0b99baffd'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:36 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:36 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "cinder-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "cinder-quobyte-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-quobyte-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" acquired by "delete_volume" :: waited 0.041s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f245127-ad16-4d59-b234-47090e9e1ed3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:37 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD" returned: 0 in 0.920s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:37 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 Jul 07 08:38:37 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:37 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD Jul 07 08:38:37 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Flow 'volume_create_manager' (1094f5de-d3eb-4637-93b1-c3c4f1ebe673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b03b894-8f9f-4cc8-b38e-60667437a2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b03b894-8f9f-4cc8-b38e-60667437a2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944044489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3de8c1-8916-4daa-b8f5-9e7266fb917c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0371597f701f41e4acf4d6a7fe63ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:37Z,use_quota=True,user_id='a9e07507b2b94246807dc15aa9228ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215ecab1-1a9d-4ef4-bb5f-beb6f73715f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215ecab1-1a9d-4ef4-bb5f-beb6f73715f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8d31f7-0507-4381-a8cd-30c507766ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8d31f7-0507-4381-a8cd-30c507766ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3de8c1-8916-4daa-b8f5-9e7266fb917c', 'volume_name': 'volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad2d518-6eec-4289-bd34-4582497d77f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad2d518-6eec-4289-bd34-4582497d77f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7b6329-f8f1-4890-9673-7ea941444627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:37 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Volume ec3de8c1-8916-4daa-b8f5-9e7266fb917c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c', 'volume_size': 1} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:37 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.450s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:37 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Deleted volume successfully. Jul 07 08:38:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-200367e6-0998-4f6a-93f9-9411538367c6 tempest-ProjectReaderTests-1717937901 None] Lock "cinder-cb17daf5-f2f4-4142-9799-59c01900f949-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:38 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD" returned: 1 in 1.718s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:38:38 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Temporary image 252c889c-268d-4f82-aa92-b8f4e9b51a5c is fetched for user 7d842b7f84ef4e65b39df0c0f56a4bac. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 08:38:38 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[301779c4-c69a-464b-85d9-a3549d4c54f9]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:39 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD Jul 07 08:38:39 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:39 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" returned: 0 in 2.646s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:39 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452 Jul 07 08:38:39 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:40 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD" returned: 0 in 1.234s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:40 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD Jul 07 08:38:40 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:41 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" returned: 0 in 1.806s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-quobyte-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452" released by "delete_volume" :: held 4.578s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Created reservations ['c7715d26-f427-406b-b3bf-a5a9ac8d0ba2', '6a8fe02a-043a-4ad6-8ed2-73bdad094050', '5638663b-f103-4505-8459-c396caf91526', '6b1be4be-9081-4f93-a9ff-b46a1bc59909'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:41 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:41 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:41 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD" returned: 1 in 1.749s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:38:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:42 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10" returned: 0 in 6.346s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4913cbdc-4a3a-4feb-be13-9d9968f6206d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:42 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 Jul 07 08:38:42 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:42 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.911s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:42 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Deleted volume successfully. Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-5aead8b3-6a69-450a-ac63-2b35c05bfbb3 tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-a16cdcbe-8ab7-4f25-8e8b-a1ae38c78452-delete_volume" released by "delete_volume" :: held 5.895s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "cinder-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "cinder-quobyte-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-quobyte-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2017396-1b25-4fa7-9723-217a71e9f69f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:42 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 Jul 07 08:38:42 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:43 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" returned: 0 in 0.958s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:38:43 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Converted 1024.00 MB image at 161.33 MB/s Jul 07 08:38:43 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 is being set with open permissions: ugo+rw Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:43 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 Jul 07 08:38:43 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:43 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065" returned: 0 in 0.830s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:43 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065 Jul 07 08:38:43 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:43 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10" returned: 0 in 0.660s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-ac524246-ab49-4465-bb85-dacbb6948c10" released by "_copy_volume_from_snapshot" :: held 10.024s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-db5e86bf-6675-4eb0-abe0-bcc792c606c7-ac524246-ab49-4465-bb85-dacbb6948c10" released by "_create_volume_from_snapshot" :: held 10.063s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.104s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.183s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944044489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3de8c1-8916-4daa-b8f5-9e7266fb917c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0371597f701f41e4acf4d6a7fe63ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:37Z,use_quota=True,user_id='a9e07507b2b94246807dc15aa9228ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Creating volume ec3de8c1-8916-4daa-b8f5-9e7266fb917c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:43 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:43 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c 1073741824 Jul 07 08:38:43 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209fb9c0-7c18-48ce-95d5-ad40ad749e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac524246-ab49-4465-bb85-dacbb6948c10', 'volume_size': 1, 'snapshot_id': 'db5e86bf-6675-4eb0-abe0-bcc792c606c7'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f12b19-323e-4a33-9bfd-c2dc539b91f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:43 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Volume volume-ac524246-ab49-4465-bb85-dacbb6948c10 (ac524246-ab49-4465-bb85-dacbb6948c10): created successfully Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f12b19-323e-4a33-9bfd-c2dc539b91f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Flow 'volume_create_manager' (28f0b8d8-e095-48d0-b461-f322dda5e325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-a19ed019-705b-405a-b3d1-fa7b84abeaac tempest-VolumeDependencyTests-1371488851 None] Created volume successfully. Jul 07 08:38:44 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065" returned: 0 in 0.714s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-quobyte-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065" released by "delete_volume" :: held 1.584s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Created reservations ['94b2463a-fcb9-43c9-b778-e92bd980a8d6', 'c7504c33-8b44-42b9-bad2-9a2733b5ddfb', '60787bd1-984c-48b7-92b5-c831e7fd1162', '6954d9ab-bed9-4cfc-aaac-f96d18affeab'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "cinder-db5e86bf-6675-4eb0-abe0-bcc792c606c7-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-db5e86bf-6675-4eb0-abe0-bcc792c606c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "cinder-quobyte-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "cinder-quobyte-db5e86bf-6675-4eb0-abe0-bcc792c606c7" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-db5e86bf-6675-4eb0-abe0-bcc792c606c7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Deleting offline snapshot db5e86bf-6675-4eb0-abe0-bcc792c606c7 of volume 373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] snapshot_file for this snap is: volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1184872f-a489-4c24-b4ad-5ce2e44b15ba]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:44 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:44 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:44 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 Jul 07 08:38:44 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:44 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c 1073741824" returned: 0 in 0.926s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:44 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c Jul 07 08:38:44 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:45 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.861s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Deleted volume successfully. Jul 07 08:38:45 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7" returned: 0 in 0.906s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[130fc79c-bc8f-446d-a69e-0d0713af1e2a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b1d68ad7-a6e3-436c-9185-ef24d1b83400 tempest-CinderUnicodeTest-1848003285 None] Lock "cinder-d3e45186-f0a5-4ad6-8f96-fb3b5d5b8065-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:45 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 Jul 07 08:38:45 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:45 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c" returned: 0 in 0.874s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.769s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957ff918-4a3c-49ff-ad43-d55169756d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7922cbfcaa4d10b6743afb04d49650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:36Z,use_quota=True,user_id='7d842b7f84ef4e65b39df0c0f56a4bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Creating volume 957ff918-4a3c-49ff-ad43-d55169756d97 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:45 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7b6329-f8f1-4890-9673-7ea941444627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38815f7-1ef6-4760-8ae2-d3bb9989c350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:45 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 1073741824 Jul 07 08:38:45 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:45 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Volume volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c (ec3de8c1-8916-4daa-b8f5-9e7266fb917c): created successfully Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38815f7-1ef6-4760-8ae2-d3bb9989c350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Flow 'volume_create_manager' (1094f5de-d3eb-4637-93b1-c3c4f1ebe673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2f0dcef8-f4c8-44f8-a307-246daf2769eb tempest-ProjectReaderTests-1717937901 None] Created volume successfully. Jul 07 08:38:46 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" returned: 0 in 0.943s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:46 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 Jul 07 08:38:46 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "cinder-ec3de8c1-8916-4daa-b8f5-9e7266fb917c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Lock "cinder-ec3de8c1-8916-4daa-b8f5-9e7266fb917c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "cinder-quobyte-ec3de8c1-8916-4daa-b8f5-9e7266fb917c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Lock "cinder-quobyte-ec3de8c1-8916-4daa-b8f5-9e7266fb917c" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ca60f5-24b3-4e00-aae4-17f992395064]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:46 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c Jul 07 08:38:46 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:46 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 1073741824" returned: 0 in 1.229s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:47 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 Jul 07 08:38:47 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:47 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7" returned: 0 in 0.894s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:47 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7 Jul 07 08:38:47 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:47 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c" returned: 0 in 1.067s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:47 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c Jul 07 08:38:47 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:47 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97" returned: 0 in 0.783s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Attempting download of 252c889c-268d-4f82-aa92-b8f4e9b51a5c ((None, [{'url': 'file:///opt/stack/data/glance/images/252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'metadata': {}}])) to volume 957ff918-4a3c-49ff-ad43-d55169756d97. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df2f7a3-e138-4589-8e2a-fc2539e4070e]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_252c889c-268d-4f82-aa92-b8f4e9b51a5c_6j8kc2rw {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:48 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_252c889c-268d-4f82-aa92-b8f4e9b51a5c_6j8kc2rw Jul 07 08:38:48 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:48 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83.db5e86bf-6675-4eb0-abe0-bcc792c606c7" returned: 0 in 0.934s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-db5e86bf-6675-4eb0-abe0-bcc792c606c7" released by "_delete_snapshot" :: held 3.815s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" released by "delete_snapshot" :: held 3.848s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Created reservations ['b8168b38-ce16-4913-aafd-5f40d02f66e4', '671419c9-b422-4892-8059-d6dadb16bffe', 'a19b2a86-f650-4517-9d1c-d049d7732861', '362997ba-ea12-46e7-a697-6430a198ed48'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:48 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Delete snapshot completed successfully. Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-dfa92c73-2d29-4ee0-8a71-e314262a408e tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-db5e86bf-6675-4eb0-abe0-bcc792c606c7-delete_snapshot" released by "delete_snapshot" :: held 4.075s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:48 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ec3de8c1-8916-4daa-b8f5-9e7266fb917c" returned: 0 in 0.768s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Lock "cinder-quobyte-ec3de8c1-8916-4daa-b8f5-9e7266fb917c" released by "delete_volume" :: held 1.896s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "cinder-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Created reservations ['60e24ad4-77ad-4c05-84bb-704e39225cce', '1f499aa3-e918-4a42-ab6e-9a673d974623', '717168bc-9bc8-4f32-a524-3a089663ed7b', 'c6944ff0-4f05-4b3e-982f-d56ad5a9bbf2'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "cinder-quobyte-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" acquired by "delete_volume" :: waited 0.041s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:48 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_252c889c-268d-4f82-aa92-b8f4e9b51a5c_6j8kc2rw" returned: 0 in 0.844s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_252c889c-268d-4f82-aa92-b8f4e9b51a5c_6j8kc2rw {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d399fa33-a76d-4d56-ba34-cce6271ae08e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:48 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:48 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:48 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_252c889c-268d-4f82-aa92-b8f4e9b51a5c_6j8kc2rw Jul 07 08:38:48 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:48 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 Jul 07 08:38:48 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:49 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (f9e8c1dd-96db-4b14-97a2-119afbbf42c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf65f014-4580-4dc4-8dd5-35a975ed14a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.886s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:49 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Deleted volume successfully. Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf65f014-4580-4dc4-8dd5-35a975ed14a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1032663858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b8fcf3-e892-440d-84ee-73e1d86cc113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:50Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0219fb9e-8542-4f4e-bb61-63e21fb52187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0219fb9e-8542-4f4e-bb61-63e21fb52187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d67b4aa-645d-4b43-a207-efb2f40bdc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d67b4aa-645d-4b43-a207-efb2f40bdc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b8fcf3-e892-440d-84ee-73e1d86cc113', 'volume_name': 'volume-61b8fcf3-e892-440d-84ee-73e1d86cc113', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903b3498-3b3c-443f-a460-86d4bfcfef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903b3498-3b3c-443f-a460-86d4bfcfef72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbade611-7127-42ab-90de-11ee0d942513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Volume 61b8fcf3-e892-440d-84ee-73e1d86cc113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b8fcf3-e892-440d-84ee-73e1d86cc113', 'volume_size': 1} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1032663858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b8fcf3-e892-440d-84ee-73e1d86cc113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:50Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Creating volume 61b8fcf3-e892-440d-84ee-73e1d86cc113 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:49 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-442450f8-f9db-49e0-92d9-903c1a5ab411 tempest-ProjectReaderTests-1717937901 None] Lock "cinder-ec3de8c1-8916-4daa-b8f5-9e7266fb917c-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:49 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 1073741824 Jul 07 08:38:49 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_252c889c-268d-4f82-aa92-b8f4e9b51a5c_6j8kc2rw" returned: 1 in 1.091s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_252c889c-268d-4f82-aa92-b8f4e9b51a5c_6j8kc2rw' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d51558-4e07-40fe-9dd1-63a8daa4c176]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:38:49 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Flow 'volume_create_manager' (34b86d35-477a-4272-91ad-60a0cc195457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a061b4fc-e706-47e3-9fcf-3f550071b671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" returned: 0 in 1.150s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a061b4fc-e706-47e3-9fcf-3f550071b671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739449680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69eef98a-f568-499e-93a6-506b82c26577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0371597f701f41e4acf4d6a7fe63ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:50Z,use_quota=True,user_id='a9e07507b2b94246807dc15aa9228ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b90c19f-3346-4598-89c7-2745e933e914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83 Jul 07 08:38:49 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b90c19f-3346-4598-89c7-2745e933e914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf5d78d-821f-4b81-aa07-cd3bb30f22fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf5d78d-821f-4b81-aa07-cd3bb30f22fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69eef98a-f568-499e-93a6-506b82c26577', 'volume_name': 'volume-69eef98a-f568-499e-93a6-506b82c26577', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:49 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD Jul 07 08:38:49 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779b12bb-ba0a-4707-9460-001dd11dcc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779b12bb-ba0a-4707-9460-001dd11dcc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b20a63-91da-41e1-bd75-b92374134820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:49 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Volume 69eef98a-f568-499e-93a6-506b82c26577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69eef98a-f568-499e-93a6-506b82c26577', 'volume_size': 1} Jul 07 08:38:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:50 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" returned: 0 in 0.722s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:50 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:50 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83" released by "delete_volume" :: held 1.975s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 1073741824" returned: 0 in 0.879s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Created reservations ['1c159c22-06ea-4534-b82c-afe83fe20722', '9fc5f3ad-a157-4b42-a8d4-f93c47de9507', '2c3821fe-0216-4edb-ac73-7b99fda85d3c', '5aa231c4-f06a-46d9-905a-92153221e907'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:50 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 Jul 07 08:38:50 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:50 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD Jul 07 08:38:50 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:50 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:50 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "cinder-ac524246-ab49-4465-bb85-dacbb6948c10-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-ac524246-ab49-4465-bb85-dacbb6948c10-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "cinder-quobyte-ac524246-ab49-4465-bb85-dacbb6948c10" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-ac524246-ab49-4465-bb85-dacbb6948c10" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bff445-cbb4-464e-9e9d-6e8e49d1f1af]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:51 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 Jul 07 08:38:51 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:51 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD" returned: 1 in 0.794s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] 252c889c-268d-4f82-aa92-b8f4e9b51a5c was raw, converting to raw {{(pid=87179) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:51 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 Jul 07 08:38:51 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:51 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.693s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Deleted volume successfully. Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-49613982-ae72-45a3-a67f-a3c96a631966 tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-373fe7e3-c43c-45e4-b5e1-3c779e5bcb83-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:51 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113" returned: 0 in 0.937s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.688s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739449680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69eef98a-f568-499e-93a6-506b82c26577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0371597f701f41e4acf4d6a7fe63ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:38:50Z,use_quota=True,user_id='a9e07507b2b94246807dc15aa9228ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Creating volume 69eef98a-f568-499e-93a6-506b82c26577 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:38:51 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbade611-7127-42ab-90de-11ee0d942513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b8fcf3-e892-440d-84ee-73e1d86cc113', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:51 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577 1073741824 Jul 07 08:38:51 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a770e4a-9d25-4aef-89d7-62a081efea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:51 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Volume volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 (61b8fcf3-e892-440d-84ee-73e1d86cc113): created successfully Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a770e4a-9d25-4aef-89d7-62a081efea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (f9e8c1dd-96db-4b14-97a2-119afbbf42c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2f24247a-20e7-4dba-8333-ce70e3e6665e tempest-ProjectMemberTests-1277025339 None] Created volume successfully. Jul 07 08:38:52 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10" returned: 0 in 0.998s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:52 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10 Jul 07 08:38:52 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:52 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97" returned: 0 in 0.860s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_252c889c-268d-4f82-aa92-b8f4e9b51a5c_rfpbgd7ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:38:52 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:52 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 1G Jul 07 08:38:52 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:52 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577 1073741824" returned: 0 in 0.878s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:52 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577 Jul 07 08:38:52 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:52 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ac524246-ab49-4465-bb85-dacbb6948c10" returned: 0 in 0.782s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-quobyte-ac524246-ab49-4465-bb85-dacbb6948c10" released by "delete_volume" :: held 1.838s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:52 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Created reservations ['0f624ca2-e0f3-4a0b-b7a6-f6219668305b', '651327be-5273-42af-860c-2fb253358daf', '67a44c15-8176-47ce-b62f-e4674b37ff8a', 'e302093a-e61d-45d0-a62f-110a6e779519'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:53 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:53 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:53 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 1G" returned: 0 in 0.847s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f602d-f8ed-4d7e-9746-37ac3a0b4d28]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:53 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 Jul 07 08:38:53 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:53 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577" returned: 0 in 0.803s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.210s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b20a63-91da-41e1-bd75-b92374134820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69eef98a-f568-499e-93a6-506b82c26577', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2642540-7054-4534-9874-faff0771745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Creating offline snapshot 7b24fcb2-cb6e-4d7f-8f87-288acb192095 of volume 61b8fcf3-e892-440d-84ee-73e1d86cc113 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:38:53 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Volume volume-69eef98a-f568-499e-93a6-506b82c26577 (69eef98a-f568-499e-93a6-506b82c26577): created successfully Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2642540-7054-4534-9874-faff0771745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Flow 'volume_create_manager' (34b86d35-477a-4272-91ad-60a0cc195457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d4402-9f73-4474-8df2-fe7f74f560e4]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:53 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-98cd1e43-3ebe-44bb-8233-ac7edaf48144 tempest-ProjectReaderTests-1717937901 None] Created volume successfully. Jul 07 08:38:53 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 Jul 07 08:38:53 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Acquiring lock "cinder-69eef98a-f568-499e-93a6-506b82c26577-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:53 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Lock "cinder-69eef98a-f568-499e-93a6-506b82c26577-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Acquiring lock "cinder-quobyte-69eef98a-f568-499e-93a6-506b82c26577" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Lock "cinder-quobyte-69eef98a-f568-499e-93a6-506b82c26577" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:54 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 1.024s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafdfc3b-08db-4c31-936b-1be95b2fc2fd]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:54 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Deleted volume successfully. Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-76f0129e-6e14-4792-8e92-8dd4cd29177d tempest-VolumeDependencyTests-1371488851 None] Lock "cinder-ac524246-ab49-4465-bb85-dacbb6948c10-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:54 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577 Jul 07 08:38:54 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:54 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97" returned: 0 in 1.065s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:54 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 Jul 07 08:38:54 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:54 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113" returned: 0 in 1.164s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:54 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 1G Jul 07 08:38:54 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:55 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577" returned: 0 in 0.964s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:55 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577 Jul 07 08:38:55 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:55 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97" returned: 1 in 0.946s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Downloaded image 252c889c-268d-4f82-aa92-b8f4e9b51a5c ((None, [{'url': 'file:///opt/stack/data/glance/images/252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'metadata': {}}])) to volume 957ff918-4a3c-49ff-ad43-d55169756d97 successfully. {{(pid=87179) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Temporary image 252c889c-268d-4f82-aa92-b8f4e9b51a5c for user 7d842b7f84ef4e65b39df0c0f56a4bac is deleted. {{(pid=87179) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.volume.volume_utils [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Marking volume 957ff918-4a3c-49ff-ad43-d55169756d97 as bootable. {{(pid=87179) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Copying metadata from image 252c889c-268d-4f82-aa92-b8f4e9b51a5c to 957ff918-4a3c-49ff-ad43-d55169756d97. {{(pid=87179) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Creating volume glance metadata for volume 957ff918-4a3c-49ff-ad43-d55169756d97 backed by image 252c889c-268d-4f82-aa92-b8f4e9b51a5c with: {'image_id': '252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2217fbe93b9f617b8182e8cc7d0a7f92', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87179) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64772616-256d-4b01-a290-85bf7e1750f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957ff918-4a3c-49ff-ad43-d55169756d97', 'volume_size': 1, 'image_id': '252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2217fbe93b9f617b8182e8cc7d0a7f92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e7922cbfcaa4d10b6743afb04d49650', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15ed9297f7a5e107c6450254a5c469abbd5f9e77891eedae01146f853b59b7d18c07d29a723b2e8bcb99efaa07f7109d56f9bf5d2126ae2f3f7ba48462ece782', 'id': '252c889c-268d-4f82-aa92-b8f4e9b51a5c', 'created_at': datetime.datetime(2026, 7, 7, 6, 38, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 6, 38, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/252c889c-268d-4f82-aa92-b8f4e9b51a5c/file', 'properties': {}}, 'image_service': }' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f85f516-c740-4397-b212-32b0de493f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:38:55 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Volume volume-957ff918-4a3c-49ff-ad43-d55169756d97 (957ff918-4a3c-49ff-ad43-d55169756d97): created successfully Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f85f516-c740-4397-b212-32b0de493f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Flow 'volume_create_manager' (4361f952-9d82-47a8-b995-27533c2dd635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:38:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-23b574ea-45a7-4999-a6dc-58afcdd460ba tempest-VolumeImageDependencyTests-84570379 None] Created volume successfully. Jul 07 08:38:55 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 1G" returned: 0 in 1.011s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:55 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 Jul 07 08:38:55 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:55 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-69eef98a-f568-499e-93a6-506b82c26577" returned: 0 in 0.780s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Lock "cinder-quobyte-69eef98a-f568-499e-93a6-506b82c26577" released by "delete_volume" :: held 1.805s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Created reservations ['713745f4-94c9-48f1-8609-d134fef90e57', '4f59a3b8-5244-4da7-a9f8-7de3cfd37ab6', '0eff305c-90c2-479f-9a9f-1a4e3bd78e31', '928843db-afee-4a5c-9247-6471b3557501'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Acquiring lock "cinder-957ff918-4a3c-49ff-ad43-d55169756d97-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Lock "cinder-957ff918-4a3c-49ff-ad43-d55169756d97-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Acquiring lock "cinder-quobyte-957ff918-4a3c-49ff-ad43-d55169756d97" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:56 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:56 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Lock "cinder-quobyte-957ff918-4a3c-49ff-ad43-d55169756d97" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f894c5-c7f5-4e89-9a6b-99b6ae1c8221]: (4, 'raw') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:56 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 Jul 07 08:38:56 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:56 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095" returned: 0 in 1.005s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:56 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 is being set with open permissions: ugo+rw Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:56 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 Jul 07 08:38:56 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:56 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.885s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:56 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Deleted volume successfully. Jul 07 08:38:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-46ec6189-d2b5-4087-9149-729eaf692caf tempest-ProjectReaderTests-1717937901 None] Lock "cinder-69eef98a-f568-499e-93a6-506b82c26577-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:57 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97" returned: 0 in 1.008s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:57 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 Jul 07 08:38:57 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:57 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095" returned: 0 in 0.769s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:57 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.info Jul 07 08:38:57 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:58 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97" returned: 1 in 0.900s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97' failed. Not Retrying. {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:58 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97 Jul 07 08:38:58 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:58 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-5fb93605-31d0-46bf-8f6d-f81bea7affe2 tempest-ProjectAdminTests-1152646922 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87179) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.info" returned: 0 in 0.760s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:58 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.info is being set with open permissions: ugo+rw Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:58 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.info Jul 07 08:38:58 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:58 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-957ff918-4a3c-49ff-ad43-d55169756d97" returned: 0 in 0.677s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Lock "cinder-quobyte-957ff918-4a3c-49ff-ad43-d55169756d97" released by "delete_volume" :: held 2.709s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Created reservations ['9d5c7e65-7295-47f7-b464-30c71591a59e', '72645acf-333f-48ba-8e11-a4944ce7b987', '96a62cbe-219c-4953-b2af-1e92b00f8cd1', '50f748bf-6ac8-42f5-839f-506e4a5699d8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:38:58 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.info" returned: 0 in 0.708s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:59 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:38:59 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.573s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:38:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-fa78103c-6040-497a-b5a7-b1507c49d5cb tempest-ProjectMemberTests-1277025339 None] Create snapshot completed successfully Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-7b24fcb2-cb6e-4d7f-8f87-288acb192095-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-7b24fcb2-cb6e-4d7f-8f87-288acb192095-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-61b8fcf3-e892-440d-84ee-73e1d86cc113" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-61b8fcf3-e892-440d-84ee-73e1d86cc113" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-7b24fcb2-cb6e-4d7f-8f87-288acb192095" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-7b24fcb2-cb6e-4d7f-8f87-288acb192095" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Deleting offline snapshot 7b24fcb2-cb6e-4d7f-8f87-288acb192095 of volume 61b8fcf3-e892-440d-84ee-73e1d86cc113 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] snapshot_file for this snap is: volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae4a4cc-0079-4e3e-b12f-c79ef3adbc77]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:38:59 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.725s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:38:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Deleted volume successfully. Jul 07 08:38:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e26534ac-1195-432e-8fb5-d58465026f1a tempest-VolumeImageDependencyTests-84570379 None] Lock "cinder-957ff918-4a3c-49ff-ad43-d55169756d97-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:38:59 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 Jul 07 08:38:59 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:00 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095" returned: 0 in 0.940s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61b8fcf3-e892-440d-84ee-73e1d86cc113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:39:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6014f2bb-05df-40dc-9690-ec16a6dbddc7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:00 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 Jul 07 08:39:00 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:01 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113" returned: 0 in 0.881s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:01 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 Jul 07 08:39:01 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:02 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095" returned: 0 in 0.894s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:02 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095 Jul 07 08:39:02 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:03 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113.7b24fcb2-cb6e-4d7f-8f87-288acb192095" returned: 0 in 0.673s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=154,cinder:UPDATE=222,cinder:INSERT=59,cinder:DELETE=22 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-7b24fcb2-cb6e-4d7f-8f87-288acb192095" released by "_delete_snapshot" :: held 3.538s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-61b8fcf3-e892-440d-84ee-73e1d86cc113" released by "delete_snapshot" :: held 3.572s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Created reservations ['fb26aec3-42e0-4353-beea-d27b27c13f55', '622a3617-c4ba-4d09-b3eb-1fe101277599', 'e7bdaab7-7147-4af6-8d01-776e84a88531', '19af65ff-3b25-435f-b7ef-245e6c11dcd2'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Delete snapshot completed successfully. Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d0065fd1-6b89-46e8-b2ef-0cf00eece4f3 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-7b24fcb2-cb6e-4d7f-8f87-288acb192095-delete_snapshot" released by "delete_snapshot" :: held 3.726s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-61b8fcf3-e892-440d-84ee-73e1d86cc113-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-61b8fcf3-e892-440d-84ee-73e1d86cc113-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-61b8fcf3-e892-440d-84ee-73e1d86cc113" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-61b8fcf3-e892-440d-84ee-73e1d86cc113" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8799f624-a8dc-4e4a-98c5-cddab57337af]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:04 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 Jul 07 08:39:04 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:39:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:04 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:39:04 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:04 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113" returned: 0 in 0.829s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:04 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113 Jul 07 08:39:04 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:05 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.800s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:39:05 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-61b8fcf3-e892-440d-84ee-73e1d86cc113" returned: 0 in 0.762s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-61b8fcf3-e892-440d-84ee-73e1d86cc113" released by "delete_volume" :: held 1.656s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Created reservations ['e5c599e3-8bb7-45f0-ab4f-32cec0730838', '2e64bd23-0919-48b5-b419-bc55e33f4388', '11dff4a4-f84c-46ba-8df6-d2fc6bbefe6e', 'f5b2fb14-e0cd-46ca-ada4-71b4afa6ee34'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:05 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:39:05 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:06 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.858s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:39:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Deleted volume successfully. Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4ddd8096-4359-42e6-ad04-6c9dbb5cea48 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-61b8fcf3-e892-440d-84ee-73e1d86cc113-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (26dd4153-1a5f-41b8-b42c-8b6e76d04055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fccc67c-0335-4ecc-bcab-b782ccdb968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fccc67c-0335-4ecc-bcab-b782ccdb968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323619983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91c3913-b43d-44fa-9535-31c76b971d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:07Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6b854-51f7-471c-a769-3e8c4bdbfd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6b854-51f7-471c-a769-3e8c4bdbfd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a4cbe7-b9e2-4142-81d6-cb873fb47a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a4cbe7-b9e2-4142-81d6-cb873fb47a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd91c3913-b43d-44fa-9535-31c76b971d4b', 'volume_name': 'volume-d91c3913-b43d-44fa-9535-31c76b971d4b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6354d1de-55d3-42cc-aa47-e7d7641fa9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6354d1de-55d3-42cc-aa47-e7d7641fa9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b683adf8-16aa-4dbf-85bb-6b74f36d9ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:06 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Volume d91c3913-b43d-44fa-9535-31c76b971d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d91c3913-b43d-44fa-9535-31c76b971d4b', 'volume_size': 1} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323619983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91c3913-b43d-44fa-9535-31c76b971d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:07Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Creating volume d91c3913-b43d-44fa-9535-31c76b971d4b {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:39:06 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:39:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:06 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b 1073741824 Jul 07 08:39:06 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:07 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b 1073741824" returned: 0 in 0.901s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:07 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b Jul 07 08:39:07 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:08 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b" returned: 0 in 0.676s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b683adf8-16aa-4dbf-85bb-6b74f36d9ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91c3913-b43d-44fa-9535-31c76b971d4b', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198b5f88-5682-43cf-8a1e-c830e1dabc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:08 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Volume volume-d91c3913-b43d-44fa-9535-31c76b971d4b (d91c3913-b43d-44fa-9535-31c76b971d4b): created successfully Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198b5f88-5682-43cf-8a1e-c830e1dabc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (26dd4153-1a5f-41b8-b42c-8b6e76d04055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9a5e39cd-53a4-48d6-a335-bc2e9b274b26 tempest-ProjectMemberTests-1277025339 None] Created volume successfully. Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (77155c53-3c09-42ad-980b-931b87dfdda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c09a66-180b-413c-9cef-588908f895c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c09a66-180b-413c-9cef-588908f895c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528715220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb9c512-5273-47f0-832e-0f4f3661be38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:08Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58afe0fb-bef3-4cce-97f6-dd94a7b5930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58afe0fb-bef3-4cce-97f6-dd94a7b5930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcdd47c-dfb0-4af4-ae09-8b0f9b397c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcdd47c-dfb0-4af4-ae09-8b0f9b397c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb9c512-5273-47f0-832e-0f4f3661be38', 'volume_name': 'volume-ecb9c512-5273-47f0-832e-0f4f3661be38', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4728a554-b940-4a58-93b8-350d33db00a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4728a554-b940-4a58-93b8-350d33db00a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c87f63-e549-476b-a02d-22d0dc53bafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:08 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Volume ecb9c512-5273-47f0-832e-0f4f3661be38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb9c512-5273-47f0-832e-0f4f3661be38', 'volume_size': 1} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528715220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb9c512-5273-47f0-832e-0f4f3661be38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:08Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Creating volume ecb9c512-5273-47f0-832e-0f4f3661be38 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:39:08 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:08 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 1073741824 Jul 07 08:39:08 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:09 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 1073741824" returned: 0 in 0.843s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:09 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 Jul 07 08:39:09 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:10 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38" returned: 0 in 0.628s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.184s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c87f63-e549-476b-a02d-22d0dc53bafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb9c512-5273-47f0-832e-0f4f3661be38', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763c1aca-a7ce-4661-9a54-b18b3da1b8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Creating offline snapshot 8d7e25bd-6c58-416c-89ea-c6232d23edc5 of volume d91c3913-b43d-44fa-9535-31c76b971d4b {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:39:10 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Volume volume-ecb9c512-5273-47f0-832e-0f4f3661be38 (ecb9c512-5273-47f0-832e-0f4f3661be38): created successfully Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763c1aca-a7ce-4661-9a54-b18b3da1b8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (77155c53-3c09-42ad-980b-931b87dfdda6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eebe286-2d52-4c74-b584-b52e8f59b8b7]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:10 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6fc496b3-57a6-4ccd-a553-05076d60015d tempest-ProjectReaderTests-647648734 None] Created volume successfully. Jul 07 08:39:10 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b Jul 07 08:39:10 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:10 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b" returned: 0 in 0.795s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:10 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 1G Jul 07 08:39:10 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:11 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 1G" returned: 0 in 0.831s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91c3913-b43d-44fa-9535-31c76b971d4b -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:11 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91c3913-b43d-44fa-9535-31c76b971d4b -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 Jul 07 08:39:11 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:12 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91c3913-b43d-44fa-9535-31c76b971d4b -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5" returned: 0 in 0.681s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:12 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 is being set with open permissions: ugo+rw Jul 07 08:39:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:12 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 Jul 07 08:39:12 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:13 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5" returned: 0 in 0.626s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:13 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.info Jul 07 08:39:13 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:13 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.info" returned: 0 in 0.662s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:13 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.info is being set with open permissions: ugo+rw Jul 07 08:39:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:13 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.info Jul 07 08:39:13 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:14 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.info" returned: 0 in 0.659s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.371s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.846s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:14 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Creating offline snapshot 8d0108ce-e729-47f7-925d-7000a08e360f of volume ecb9c512-5273-47f0-832e-0f4f3661be38 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:39:14 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cdcc7f-078d-4853-95c1-8a750bcf84d0]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:14 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9ddb4586-6a61-4e23-b63d-56757c8f8b56 tempest-ProjectMemberTests-1277025339 None] Create snapshot completed successfully Jul 07 08:39:14 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 Jul 07 08:39:14 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-8d7e25bd-6c58-416c-89ea-c6232d23edc5-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-8d7e25bd-6c58-416c-89ea-c6232d23edc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-d91c3913-b43d-44fa-9535-31c76b971d4b" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d91c3913-b43d-44fa-9535-31c76b971d4b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-8d7e25bd-6c58-416c-89ea-c6232d23edc5" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-8d7e25bd-6c58-416c-89ea-c6232d23edc5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Deleting offline snapshot 8d7e25bd-6c58-416c-89ea-c6232d23edc5 of volume d91c3913-b43d-44fa-9535-31c76b971d4b {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] snapshot_file for this snap is: volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6985af95-7bae-48a4-9434-c869e9a84a85]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:15 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38" returned: 0 in 0.890s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:15 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 Jul 07 08:39:15 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:15 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f 1G Jul 07 08:39:15 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:16 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5" returned: 0 in 0.853s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:16 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91c3913-b43d-44fa-9535-31c76b971d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:39:16 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb5bdf-b375-41a7-a585-9ccd5abdeca6]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:16 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b Jul 07 08:39:16 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:16 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f 1G" returned: 0 in 1.014s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb9c512-5273-47f0-832e-0f4f3661be38 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:16 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb9c512-5273-47f0-832e-0f4f3661be38 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f Jul 07 08:39:16 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:17 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b" returned: 0 in 0.936s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:17 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 Jul 07 08:39:17 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:17 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb9c512-5273-47f0-832e-0f4f3661be38 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f" returned: 0 in 0.898s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:17 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f is being set with open permissions: ugo+rw Jul 07 08:39:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:17 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f Jul 07 08:39:17 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:17 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5" returned: 0 in 0.832s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:17 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5 Jul 07 08:39:17 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:17 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f" returned: 0 in 0.713s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:18 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.info Jul 07 08:39:18 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:18 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b.8d7e25bd-6c58-416c-89ea-c6232d23edc5" returned: 0 in 0.737s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-8d7e25bd-6c58-416c-89ea-c6232d23edc5" released by "_delete_snapshot" :: held 3.485s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d91c3913-b43d-44fa-9535-31c76b971d4b" released by "delete_snapshot" :: held 3.516s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:18 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.info" returned: 0 in 0.732s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:18 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.info is being set with open permissions: ugo+rw Jul 07 08:39:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:18 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.info Jul 07 08:39:18 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:18 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Created reservations ['1e16a903-04cb-4811-ba0a-82827040b304', 'dbcf446a-d20f-4929-b83f-1098a647ed08', 'd5daa7d1-fb5c-4e69-ad9c-d901843349a5', '9d8a1434-49c4-46ed-b86f-5b86706f48e7'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:18 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Delete snapshot completed successfully. Jul 07 08:39:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e565ee8d-c9fa-4ce5-a762-dd090279eb91 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-8d7e25bd-6c58-416c-89ea-c6232d23edc5-delete_snapshot" released by "delete_snapshot" :: held 3.737s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:19 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.info" returned: 0 in 0.652s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.990s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-d91c3913-b43d-44fa-9535-31c76b971d4b-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Lock "cinder-d91c3913-b43d-44fa-9535-31c76b971d4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:19 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b7115212-4b52-4dda-bc7d-3d668f370825 tempest-ProjectReaderTests-647648734 None] Create snapshot completed successfully Jul 07 08:39:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-d91c3913-b43d-44fa-9535-31c76b971d4b" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d91c3913-b43d-44fa-9535-31c76b971d4b" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:19 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4532fa-038d-4ccd-bf2d-9a6c3f7524da]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:19 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b Jul 07 08:39:19 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-8d0108ce-e729-47f7-925d-7000a08e360f-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Lock "cinder-8d0108ce-e729-47f7-925d-7000a08e360f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-ecb9c512-5273-47f0-832e-0f4f3661be38" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-ecb9c512-5273-47f0-832e-0f4f3661be38" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-8d0108ce-e729-47f7-925d-7000a08e360f" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-8d0108ce-e729-47f7-925d-7000a08e360f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Deleting offline snapshot 8d0108ce-e729-47f7-925d-7000a08e360f of volume ecb9c512-5273-47f0-832e-0f4f3661be38 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] snapshot_file for this snap is: volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b75383-94cb-4aae-8f84-4a07bfd3e16f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:20 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b" returned: 0 in 0.765s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:20 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f Jul 07 08:39:20 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:20 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b Jul 07 08:39:20 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:21 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d91c3913-b43d-44fa-9535-31c76b971d4b" returned: 0 in 0.728s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:21 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f" returned: 0 in 0.851s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb9c512-5273-47f0-832e-0f4f3661be38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d91c3913-b43d-44fa-9535-31c76b971d4b" released by "delete_volume" :: held 1.583s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66238c4-2f16-4cd6-b1f5-ef8cf70b21a1]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Created reservations ['497d7f0e-b4e1-4bde-ac05-2ef6e2469e32', '3c86c3aa-da84-40ce-952d-1d1866151a51', 'df7fb4d8-4141-463c-b08d-50218f74c266', '07d88935-ddb9-493e-abfa-5d117a9165d8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:21 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 Jul 07 08:39:21 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:21 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:39:21 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:22 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38" returned: 0 in 0.919s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:22 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f Jul 07 08:39:22 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:22 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.868s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:39:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Deleted volume successfully. Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b6a01ece-dc33-43e5-8a9f-ed05e74b25af tempest-ProjectMemberTests-1277025339 None] Lock "cinder-d91c3913-b43d-44fa-9535-31c76b971d4b-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (28cfc919-f074-4f64-a5d8-3b58c6cb8c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b73af50-9e82-490c-964b-cf932a212a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b73af50-9e82-490c-964b-cf932a212a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742101681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4185bef8-3b13-46a6-b4e9-ec059ba8712c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:22Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa2e0ff-0011-4b29-895c-229a6259e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa2e0ff-0011-4b29-895c-229a6259e980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be08bd7-a592-424c-ace6-f5efeb8b4068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be08bd7-a592-424c-ace6-f5efeb8b4068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4185bef8-3b13-46a6-b4e9-ec059ba8712c', 'volume_name': 'volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2591a079-1b2c-41ea-9dc9-7b4a3f3194a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2591a079-1b2c-41ea-9dc9-7b4a3f3194a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63394451-3b9e-4cba-a761-7c8483deb89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:22 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Volume 4185bef8-3b13-46a6-b4e9-ec059ba8712c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c', 'volume_size': 1} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742101681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4185bef8-3b13-46a6-b4e9-ec059ba8712c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:22Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Creating volume 4185bef8-3b13-46a6-b4e9-ec059ba8712c {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:39:22 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:22 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c 1073741824 Jul 07 08:39:22 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:22 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f" returned: 0 in 0.912s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:22 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f Jul 07 08:39:22 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:23 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c 1073741824" returned: 0 in 1.011s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:23 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c Jul 07 08:39:23 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:23 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38.8d0108ce-e729-47f7-925d-7000a08e360f" returned: 0 in 0.677s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-8d0108ce-e729-47f7-925d-7000a08e360f" released by "_delete_snapshot" :: held 3.461s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-ecb9c512-5273-47f0-832e-0f4f3661be38" released by "delete_snapshot" :: held 3.487s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:23 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Created reservations ['1d12a991-8b39-4cfc-a848-f8aa86890518', '07016b10-18dd-4eea-b2f7-670244a40fb9', '86739b94-78ad-41ee-bbd9-29d223352570', 'b9c92187-d034-4ff1-a753-e8415cbafa8d'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:23 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Delete snapshot completed successfully. Jul 07 08:39:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9250f5f8-3436-4863-ad0c-7b815c2651d4 tempest-ProjectReaderTests-647648734 None] Lock "cinder-8d0108ce-e729-47f7-925d-7000a08e360f-delete_snapshot" released by "delete_snapshot" :: held 3.644s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:24 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c" returned: 0 in 0.658s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63394451-3b9e-4cba-a761-7c8483deb89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1770a4ec-6b31-4ae6-9574-65ee0567cc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:24 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Volume volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c (4185bef8-3b13-46a6-b4e9-ec059ba8712c): created successfully Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1770a4ec-6b31-4ae6-9574-65ee0567cc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (28cfc919-f074-4f64-a5d8-3b58c6cb8c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-53324613-3182-47f1-90d4-119dc4ca441a tempest-ProjectMemberTests-1277025339 None] Created volume successfully. Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-ecb9c512-5273-47f0-832e-0f4f3661be38-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Creating offline snapshot 789ce3bd-3481-417a-ad85-12c18fa31fa5 of volume 4185bef8-3b13-46a6-b4e9-ec059ba8712c {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Lock "cinder-ecb9c512-5273-47f0-832e-0f4f3661be38-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6216fd-ac5d-4331-abb4-7a42aee85f3d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-ecb9c512-5273-47f0-832e-0f4f3661be38" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-ecb9c512-5273-47f0-832e-0f4f3661be38" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd232a58-f179-4260-94d4-c912e30f4df1]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:24 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c Jul 07 08:39:24 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:24 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 Jul 07 08:39:24 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:25 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c" returned: 0 in 0.888s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:25 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38" returned: 0 in 0.807s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:25 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 1G Jul 07 08:39:25 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:25 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38 Jul 07 08:39:25 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:26 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-ecb9c512-5273-47f0-832e-0f4f3661be38" returned: 0 in 0.708s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-ecb9c512-5273-47f0-832e-0f4f3661be38" released by "delete_volume" :: held 1.584s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Created reservations ['63633fd1-5e2d-4a8f-9116-3b49c708c111', '441157f3-6853-4db1-afaa-6022fa709317', 'd5bfe7da-f112-47f8-8bb6-45709b027e65', 'fc48cd2a-b7df-48ae-9c51-ed8b22a4f570'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:26 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:39:26 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:26 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 1G" returned: 0 in 0.981s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:26 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 Jul 07 08:39:26 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:27 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.767s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:39:27 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Deleted volume successfully. Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-cb43c3d1-0097-4b0c-b42e-90e88f8a088c tempest-ProjectReaderTests-647648734 None] Lock "cinder-ecb9c512-5273-47f0-832e-0f4f3661be38-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:27 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5" returned: 0 in 0.902s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:27 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 is being set with open permissions: ugo+rw Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:27 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 Jul 07 08:39:27 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (09943bbd-235c-44c6-a111-b18d0ea6dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817d2fe7-af65-46ec-9117-061b02d59207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817d2fe7-af65-46ec-9117-061b02d59207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983295188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:27Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5c7f9f-11c1-4d55-bf1c-13d9fcb3d66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5c7f9f-11c1-4d55-bf1c-13d9fcb3d66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a8358f-db4e-471e-b424-938a801dc460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a8358f-db4e-471e-b424-938a801dc460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d', 'volume_name': 'volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb0ae0b-dd9b-4957-afb3-37496b751063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb0ae0b-dd9b-4957-afb3-37496b751063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26f0241-2a45-4b00-82e6-c73c266a84f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:27 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Volume 9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d', 'volume_size': 1} Jul 07 08:39:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:28 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5" returned: 0 in 0.694s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:28 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.info Jul 07 08:39:28 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:28 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.info" returned: 0 in 0.687s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:28 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.info is being set with open permissions: ugo+rw Jul 07 08:39:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:28 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.info Jul 07 08:39:28 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:29 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.info" returned: 0 in 0.694s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.958s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.011s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983295188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:27Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Creating volume 9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:39:29 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:29 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d 1073741824 Jul 07 08:39:29 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=118,cinder:INSERT=46,cinder:UPDATE=162,cinder:DELETE=6 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:39:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-45fbb4cb-a667-461c-93fe-860bb1e9ec21 tempest-ProjectMemberTests-1277025339 None] Create snapshot completed successfully Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-789ce3bd-3481-417a-ad85-12c18fa31fa5-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-789ce3bd-3481-417a-ad85-12c18fa31fa5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-4185bef8-3b13-46a6-b4e9-ec059ba8712c" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-4185bef8-3b13-46a6-b4e9-ec059ba8712c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-789ce3bd-3481-417a-ad85-12c18fa31fa5" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-789ce3bd-3481-417a-ad85-12c18fa31fa5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Deleting offline snapshot 789ce3bd-3481-417a-ad85-12c18fa31fa5 of volume 4185bef8-3b13-46a6-b4e9-ec059ba8712c {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] snapshot_file for this snap is: volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a50a61e-e1e8-43e1-b849-696b95836e6c]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:30 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 Jul 07 08:39:30 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:30 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d 1073741824" returned: 0 in 1.014s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:30 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d Jul 07 08:39:30 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:30 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5" returned: 0 in 0.884s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:30 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:39:30 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b9740f-67e8-49ef-9fc8-874d93291823]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:31 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c Jul 07 08:39:31 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:31 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" returned: 0 in 0.768s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26f0241-2a45-4b00-82e6-c73c266a84f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df74bce-85e3-4a5d-8913-195ae9ed46f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Volume volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d (9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d): created successfully Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df74bce-85e3-4a5d-8913-195ae9ed46f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (09943bbd-235c-44c6-a111-b18d0ea6dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-58bfe0a8-3002-4a3b-8ad3-05956b507a9e tempest-ProjectReaderTests-647648734 None] Created volume successfully. Jul 07 08:39:31 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c" returned: 0 in 0.863s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:31 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 Jul 07 08:39:31 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Creating offline snapshot f31f557a-5732-4755-8743-3e227f56f03d of volume 9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa19b846-4748-4eaf-874b-51784344bdd2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:31 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d Jul 07 08:39:31 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:32 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5" returned: 0 in 0.793s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:32 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5 Jul 07 08:39:32 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:32 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" returned: 0 in 0.875s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:32 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d 1G Jul 07 08:39:32 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:33 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c.789ce3bd-3481-417a-ad85-12c18fa31fa5" returned: 0 in 0.691s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-789ce3bd-3481-417a-ad85-12c18fa31fa5" released by "_delete_snapshot" :: held 3.353s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-4185bef8-3b13-46a6-b4e9-ec059ba8712c" released by "delete_snapshot" :: held 3.382s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:33 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Created reservations ['b94bdcff-9ee8-4c11-aa81-967cf89fb5ae', 'b693dfdd-effa-4365-953a-ba33d8d1b3d8', '0fbfc1b3-0c48-4271-905f-c4ed21df55f1', '6a188b8f-a520-4648-964f-0e01cca6a54b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Delete snapshot completed successfully. Jul 07 08:39:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f76831a5-66ce-4503-9104-cefaf7e7e1f5 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-789ce3bd-3481-417a-ad85-12c18fa31fa5-delete_snapshot" released by "delete_snapshot" :: held 3.541s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:33 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d 1G" returned: 0 in 0.893s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:33 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d Jul 07 08:39:33 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-4185bef8-3b13-46a6-b4e9-ec059ba8712c-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-4185bef8-3b13-46a6-b4e9-ec059ba8712c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-4185bef8-3b13-46a6-b4e9-ec059ba8712c" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-4185bef8-3b13-46a6-b4e9-ec059ba8712c" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:34 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d0a0c2-6426-432f-aa2b-0ee81b51388a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:34 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c Jul 07 08:39:34 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:34 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d" returned: 0 in 0.715s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:34 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d is being set with open permissions: ugo+rw Jul 07 08:39:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:34 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d Jul 07 08:39:34 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:35 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c" returned: 0 in 0.799s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:35 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d" returned: 0 in 0.687s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:35 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c Jul 07 08:39:35 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:35 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.info Jul 07 08:39:35 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:35 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-4185bef8-3b13-46a6-b4e9-ec059ba8712c" returned: 0 in 0.670s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-4185bef8-3b13-46a6-b4e9-ec059ba8712c" released by "delete_volume" :: held 1.536s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:35 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.info" returned: 0 in 0.687s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:35 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.info is being set with open permissions: ugo+rw Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:35 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.info Jul 07 08:39:35 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Created reservations ['a6fd631b-1b67-4d87-9f54-2df42091c795', '6afe44d5-a400-4a4e-bc20-d46f01e19477', '60222795-7ca5-4187-bd7b-5d4991a3f4bd', 'ec07acdd-77ab-4367-acfe-61fffea0325c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:35 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:39:35 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:36 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.info" returned: 0 in 0.683s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.651s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-41011404-606f-45cd-8394-312ced5296a4 tempest-ProjectReaderTests-647648734 None] Create snapshot completed successfully Jul 07 08:39:36 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.649s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:39:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Deleted volume successfully. Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-97b85333-f988-481d-a91b-33ece6fa3893 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-4185bef8-3b13-46a6-b4e9-ec059ba8712c-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (0cac524f-0753-485d-bab1-4e82ab3daca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a20603-d818-41f5-a574-bc49cf4a0d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a20603-d818-41f5-a574-bc49cf4a0d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325984741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343b51a7-1dee-486f-beff-09272033f2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:37Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f0cc3-2ea0-41f9-bf0b-50cdac81aa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2f0cc3-2ea0-41f9-bf0b-50cdac81aa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f71ef8-a797-4cdf-871d-d7aa73811347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f71ef8-a797-4cdf-871d-d7aa73811347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343b51a7-1dee-486f-beff-09272033f2cc', 'volume_name': 'volume-343b51a7-1dee-486f-beff-09272033f2cc', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9bc4fd-3db0-4ecc-a8a0-d616608273b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9bc4fd-3db0-4ecc-a8a0-d616608273b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b606828f-fb2b-420f-8ff2-cc7dc897c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:36 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Volume 343b51a7-1dee-486f-beff-09272033f2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343b51a7-1dee-486f-beff-09272033f2cc', 'volume_size': 1} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325984741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343b51a7-1dee-486f-beff-09272033f2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:37Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Creating volume 343b51a7-1dee-486f-beff-09272033f2cc {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:39:36 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:39:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:36 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc 1073741824 Jul 07 08:39:36 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-f31f557a-5732-4755-8743-3e227f56f03d-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Lock "cinder-f31f557a-5732-4755-8743-3e227f56f03d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-f31f557a-5732-4755-8743-3e227f56f03d" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-f31f557a-5732-4755-8743-3e227f56f03d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Deleting offline snapshot f31f557a-5732-4755-8743-3e227f56f03d of volume 9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] snapshot_file for this snap is: volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e1f413-79c2-4d91-8176-27e7b25e25d3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:37 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d Jul 07 08:39:37 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:37 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc 1073741824" returned: 0 in 0.822s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:37 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc Jul 07 08:39:37 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:37 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d" returned: 0 in 0.798s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcea4f77-e930-4de2-9522-c7546bad88ba]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:38 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d Jul 07 08:39:38 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:38 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc" returned: 0 in 0.668s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:38 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:39:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b606828f-fb2b-420f-8ff2-cc7dc897c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343b51a7-1dee-486f-beff-09272033f2cc', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a55d522-9aef-47a9-b20d-95cfe800fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:38 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Volume volume-343b51a7-1dee-486f-beff-09272033f2cc (343b51a7-1dee-486f-beff-09272033f2cc): created successfully Jul 07 08:39:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a55d522-9aef-47a9-b20d-95cfe800fa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (0cac524f-0753-485d-bab1-4e82ab3daca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6d4fc98d-71a2-4d6b-a8f3-b4273adfed17 tempest-ProjectMemberTests-1277025339 None] Created volume successfully. Jul 07 08:39:38 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" returned: 0 in 0.830s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:38 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d Jul 07 08:39:38 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Creating offline snapshot 6d8c8edd-5b86-454d-8760-dabdd36adbf5 of volume 343b51a7-1dee-486f-beff-09272033f2cc {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:39:39 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d765bc6-a148-4e67-bd96-fe48f45fc63b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:39 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc Jul 07 08:39:39 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:39 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d" returned: 0 in 0.774s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:39 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d Jul 07 08:39:39 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:39 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc" returned: 0 in 0.796s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:39 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 1G Jul 07 08:39:39 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:40 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d.f31f557a-5732-4755-8743-3e227f56f03d" returned: 0 in 0.684s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-f31f557a-5732-4755-8743-3e227f56f03d" released by "_delete_snapshot" :: held 3.190s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" released by "delete_snapshot" :: held 3.215s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:40 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Created reservations ['a672b775-8d6d-42e4-8b65-8a1091fca1db', 'd7aac7de-ff1c-4a07-9b8c-53272918dd85', '0c0b907b-31ad-47fc-922e-7268a3d3bb2a', '1e9b5a71-1e87-495d-b2a9-e1419a211c17'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:40 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Delete snapshot completed successfully. Jul 07 08:39:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-791af8e5-2441-4db3-8afd-fd09c6fd1384 tempest-ProjectReaderTests-647648734 None] Lock "cinder-f31f557a-5732-4755-8743-3e227f56f03d-delete_snapshot" released by "delete_snapshot" :: held 3.363s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:40 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 1G" returned: 0 in 0.814s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343b51a7-1dee-486f-beff-09272033f2cc -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:40 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343b51a7-1dee-486f-beff-09272033f2cc -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 Jul 07 08:39:40 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Lock "cinder-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:41 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:41 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[07584012-8452-462d-9357-f6c099be0074]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:41 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343b51a7-1dee-486f-beff-09272033f2cc -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5" returned: 0 in 0.772s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:41 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 is being set with open permissions: ugo+rw Jul 07 08:39:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:41 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 Jul 07 08:39:41 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:41 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d Jul 07 08:39:41 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:42 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5" returned: 0 in 0.719s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:42 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.info Jul 07 08:39:42 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:42 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" returned: 0 in 0.859s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:42 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d Jul 07 08:39:42 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:42 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.info" returned: 0 in 0.731s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:42 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.info is being set with open permissions: ugo+rw Jul 07 08:39:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:42 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" returned: 0 in 0.695s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:42 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.info Jul 07 08:39:42 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d" released by "delete_volume" :: held 1.626s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Created reservations ['84d45f58-4898-4350-a61b-12c31bbe6bd2', '1c7f79aa-be85-499e-9454-73c7e7c235b3', '34f75edd-e10c-4da5-8ebe-54b5dbfac223', '476e2f06-b4cf-4457-b736-b34061719a18'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:43 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:39:43 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:43 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.info" returned: 0 in 0.749s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.674s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-58e2f78a-50ea-4c4a-a11a-3853c57cd28b tempest-ProjectMemberTests-1277025339 None] Create snapshot completed successfully Jul 07 08:39:43 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.706s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:39:43 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Deleted volume successfully. Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-295ed1c0-d04d-4984-96c1-f24de95b047e tempest-ProjectReaderTests-647648734 None] Lock "cinder-9a2c0b3e-4e5d-4b30-ba18-5422a052ac3d-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (9cd459d3-eb65-4967-ac9f-3aadb63161a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe4f766-0a87-4aa2-8c83-54ee295ccde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe4f766-0a87-4aa2-8c83-54ee295ccde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1377686115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a721767-9251-4771-af3e-5befc9474701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:44Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:43 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f279fc5-b4c0-4401-8219-1ad3698415b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f279fc5-b4c0-4401-8219-1ad3698415b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4295cde0-5e9c-4962-be18-5d33c80fd8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4295cde0-5e9c-4962-be18-5d33c80fd8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a721767-9251-4771-af3e-5befc9474701', 'volume_name': 'volume-9a721767-9251-4771-af3e-5befc9474701', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7142471-cb6b-4186-af4c-a37fc1bba00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7142471-cb6b-4186-af4c-a37fc1bba00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e1037e-03ec-4dc8-b1eb-9e829bb56ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:44 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Volume 9a721767-9251-4771-af3e-5befc9474701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a721767-9251-4771-af3e-5befc9474701', 'volume_size': 1} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1377686115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a721767-9251-4771-af3e-5befc9474701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:44Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Creating volume 9a721767-9251-4771-af3e-5befc9474701 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:39:44 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:44 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 1073741824 Jul 07 08:39:44 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-6d8c8edd-5b86-454d-8760-dabdd36adbf5-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-6d8c8edd-5b86-454d-8760-dabdd36adbf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-343b51a7-1dee-486f-beff-09272033f2cc" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-343b51a7-1dee-486f-beff-09272033f2cc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-6d8c8edd-5b86-454d-8760-dabdd36adbf5" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-6d8c8edd-5b86-454d-8760-dabdd36adbf5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Deleting offline snapshot 6d8c8edd-5b86-454d-8760-dabdd36adbf5 of volume 343b51a7-1dee-486f-beff-09272033f2cc {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] snapshot_file for this snap is: volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b97f97f-5401-4736-a504-e5d0b3d2115a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:44 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 Jul 07 08:39:44 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:44 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 1073741824" returned: 0 in 0.933s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:45 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 Jul 07 08:39:45 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:45 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5" returned: 0 in 0.852s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343b51a7-1dee-486f-beff-09272033f2cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e0e67f-66e4-4528-b5e6-6726965cd0d3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:45 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc Jul 07 08:39:45 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:45 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701" returned: 0 in 0.696s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e1037e-03ec-4dc8-b1eb-9e829bb56ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a721767-9251-4771-af3e-5befc9474701', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de6a02c-6835-4259-9ff0-3ed3cb160aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:45 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Volume volume-9a721767-9251-4771-af3e-5befc9474701 (9a721767-9251-4771-af3e-5befc9474701): created successfully Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de6a02c-6835-4259-9ff0-3ed3cb160aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:45 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (9cd459d3-eb65-4967-ac9f-3aadb63161a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b1eac0c9-3a3c-4474-ab32-47b69dd28000 tempest-ProjectReaderTests-647648734 None] Created volume successfully. Jul 07 08:39:46 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc" returned: 0 in 0.819s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:46 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 Jul 07 08:39:46 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Creating offline snapshot c8cff7e7-957f-4d93-b96b-65554d290536 of volume 9a721767-9251-4771-af3e-5befc9474701 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:39:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fff43ad-2e94-41a3-a3bd-a31e7bbb67d2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:46 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 Jul 07 08:39:46 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:46 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5" returned: 0 in 0.774s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:46 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5 Jul 07 08:39:46 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:47 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701" returned: 0 in 0.848s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:47 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 1G Jul 07 08:39:47 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:47 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc.6d8c8edd-5b86-454d-8760-dabdd36adbf5" returned: 0 in 0.638s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-6d8c8edd-5b86-454d-8760-dabdd36adbf5" released by "_delete_snapshot" :: held 3.191s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-343b51a7-1dee-486f-beff-09272033f2cc" released by "delete_snapshot" :: held 3.214s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:47 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Created reservations ['bb631a74-0aa8-47cd-a64f-2d785d61921d', 'd2aca0a0-3353-4895-b250-3d697db1d8c8', '94ff456f-ddb5-435c-994b-242c56e3d24c', '6fe74e31-95b2-4550-938d-ea43c004e87b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Delete snapshot completed successfully. Jul 07 08:39:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-8c293327-863d-45e9-9202-d8fa8f89a3b2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-6d8c8edd-5b86-454d-8760-dabdd36adbf5-delete_snapshot" released by "delete_snapshot" :: held 3.367s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:47 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 1G" returned: 0 in 0.834s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a721767-9251-4771-af3e-5befc9474701 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:47 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a721767-9251-4771-af3e-5befc9474701 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 Jul 07 08:39:47 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-343b51a7-1dee-486f-beff-09272033f2cc-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Lock "cinder-343b51a7-1dee-486f-beff-09272033f2cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-343b51a7-1dee-486f-beff-09272033f2cc" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-343b51a7-1dee-486f-beff-09272033f2cc" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:48 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b2f6f7-db10-4571-b20d-1dc4127ea50e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:48 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a721767-9251-4771-af3e-5befc9474701 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536" returned: 0 in 0.740s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:48 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 is being set with open permissions: ugo+rw Jul 07 08:39:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:48 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 Jul 07 08:39:48 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:48 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc Jul 07 08:39:48 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:49 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536" returned: 0 in 0.710s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:49 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc" returned: 0 in 0.814s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:49 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.info Jul 07 08:39:49 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:49 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc Jul 07 08:39:49 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:50 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-343b51a7-1dee-486f-beff-09272033f2cc" returned: 0 in 0.665s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-343b51a7-1dee-486f-beff-09272033f2cc" released by "delete_volume" :: held 1.550s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:50 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.info" returned: 0 in 0.749s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:50 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.info is being set with open permissions: ugo+rw Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:50 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.info Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Created reservations ['8294b9e3-f738-49f8-a8cc-7fd3f1d9f186', 'fca156b6-2a7d-4e27-bc06-68f621960de1', 'faee7490-072a-471e-b94b-51751347d8de', 'ae0bab3b-eaec-4fe0-a1ab-3265dc20bd30'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:50 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:50 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:39:50 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:50 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.info" returned: 0 in 0.678s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.655s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4de83d33-8bb9-46dc-8f67-950493b545ff tempest-ProjectReaderTests-647648734 None] Create snapshot completed successfully Jul 07 08:39:51 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.733s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:39:51 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Deleted volume successfully. Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b270ea36-c800-43e5-b134-343875a1270d tempest-ProjectMemberTests-1277025339 None] Lock "cinder-343b51a7-1dee-486f-beff-09272033f2cc-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (0f4c751c-b95a-4ed9-bece-f884475f591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61ce37d-85f1-4574-994e-f5fb0651c042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61ce37d-85f1-4574-994e-f5fb0651c042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685864652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b058003-8f88-45c4-a4cc-21ab92fba668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:51Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc788f1-5673-479c-80e6-59c3f424c708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc788f1-5673-479c-80e6-59c3f424c708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767b7529-50c8-4f06-b5e3-d5b9222a2f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767b7529-50c8-4f06-b5e3-d5b9222a2f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b058003-8f88-45c4-a4cc-21ab92fba668', 'volume_name': 'volume-8b058003-8f88-45c4-a4cc-21ab92fba668', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae52f3-10d1-44d0-9d96-b4474ca69337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae52f3-10d1-44d0-9d96-b4474ca69337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787d5ecb-857a-4640-83cb-d0f29994350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:51 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Volume 8b058003-8f88-45c4-a4cc-21ab92fba668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b058003-8f88-45c4-a4cc-21ab92fba668', 'volume_size': 1} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685864652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b058003-8f88-45c4-a4cc-21ab92fba668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:51Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Creating volume 8b058003-8f88-45c4-a4cc-21ab92fba668 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:39:51 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:51 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 1073741824 Jul 07 08:39:51 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-c8cff7e7-957f-4d93-b96b-65554d290536-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Lock "cinder-c8cff7e7-957f-4d93-b96b-65554d290536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-9a721767-9251-4771-af3e-5befc9474701" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-9a721767-9251-4771-af3e-5befc9474701" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-c8cff7e7-957f-4d93-b96b-65554d290536" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-c8cff7e7-957f-4d93-b96b-65554d290536" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Deleting offline snapshot c8cff7e7-957f-4d93-b96b-65554d290536 of volume 9a721767-9251-4771-af3e-5befc9474701 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] snapshot_file for this snap is: volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4356b8-1c8b-481f-886a-bc5599942b2a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:51 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 Jul 07 08:39:51 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:52 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 1073741824" returned: 0 in 0.844s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:52 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 Jul 07 08:39:52 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:52 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536" returned: 0 in 0.869s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a721767-9251-4771-af3e-5befc9474701(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0acb325-28ea-45ad-88f4-1f65f6ea3080]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:52 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 Jul 07 08:39:52 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:52 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668" returned: 0 in 0.668s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787d5ecb-857a-4640-83cb-d0f29994350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b058003-8f88-45c4-a4cc-21ab92fba668', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cd6589-4ee2-4f09-b0d4-f9b2606b0d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:52 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Volume volume-8b058003-8f88-45c4-a4cc-21ab92fba668 (8b058003-8f88-45c4-a4cc-21ab92fba668): created successfully Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cd6589-4ee2-4f09-b0d4-f9b2606b0d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:52 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (0f4c751c-b95a-4ed9-bece-f884475f591e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:52 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9b3bf8b7-1f04-45cf-ac76-ce74e7219224 tempest-ProjectMemberTests-1277025339 None] Created volume successfully. Jul 07 08:39:53 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701" returned: 0 in 0.839s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:53 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 Jul 07 08:39:53 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:53 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Creating offline snapshot d0959737-1c82-4565-bac3-e9d312210589 of volume 8b058003-8f88-45c4-a4cc-21ab92fba668 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:39:53 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e633787-5df2-4b33-aea2-5447d62fcd0d]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:53 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 Jul 07 08:39:53 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:54 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536" returned: 0 in 0.825s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:54 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536 Jul 07 08:39:54 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:54 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668" returned: 0 in 0.781s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:54 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 1G Jul 07 08:39:54 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:54 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701.c8cff7e7-957f-4d93-b96b-65554d290536" returned: 0 in 0.646s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-c8cff7e7-957f-4d93-b96b-65554d290536" released by "_delete_snapshot" :: held 3.281s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-9a721767-9251-4771-af3e-5befc9474701" released by "delete_snapshot" :: held 3.306s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:54 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Created reservations ['d991a4d1-1163-4e00-b32c-e1b595817914', 'f4f1be12-8b4a-4fd6-97bc-f8d300e1385a', 'b4d2b44d-8503-4a2a-8549-bceb588aee29', '5a6c2123-360e-41da-baba-844e52235a22'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:54 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Delete snapshot completed successfully. Jul 07 08:39:54 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-e0ed5746-e473-426a-b82e-e8d7bd43b800 tempest-ProjectReaderTests-647648734 None] Lock "cinder-c8cff7e7-957f-4d93-b96b-65554d290536-delete_snapshot" released by "delete_snapshot" :: held 3.438s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:55 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 1G" returned: 0 in 0.801s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b058003-8f88-45c4-a4cc-21ab92fba668 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:55 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b058003-8f88-45c4-a4cc-21ab92fba668 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 Jul 07 08:39:55 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-9a721767-9251-4771-af3e-5befc9474701-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Lock "cinder-9a721767-9251-4771-af3e-5befc9474701-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-9a721767-9251-4771-af3e-5befc9474701" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:55 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-9a721767-9251-4771-af3e-5befc9474701" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b058003-8f88-45c4-a4cc-21ab92fba668 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589" returned: 0 in 0.728s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:55 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 is being set with open permissions: ugo+rw Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4925b1e4-a76d-46d8-8da1-9ee2618ca7c9]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:55 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 Jul 07 08:39:55 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:55 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 Jul 07 08:39:55 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:56 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589" returned: 0 in 0.643s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:56 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.info Jul 07 08:39:56 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:56 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701" returned: 0 in 0.725s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:56 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701 Jul 07 08:39:56 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:57 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a721767-9251-4771-af3e-5befc9474701" returned: 0 in 0.604s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:57 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-9a721767-9251-4771-af3e-5befc9474701" released by "delete_volume" :: held 1.395s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.info" returned: 0 in 0.696s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:57 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.info is being set with open permissions: ugo+rw Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:57 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.info Jul 07 08:39:57 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Created reservations ['b5e007b2-f995-4a4b-9d87-c368f9ff3298', 'ae5540f1-8862-4264-bb90-1dc78deb1b11', '647dd0ed-96d3-4bf0-a856-662ddcc701db', '12cdd7c9-e509-4de4-a030-e337635620e4'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:57 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:39:57 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:57 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.info" returned: 0 in 0.615s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.353s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-5d7557a9-0171-48bf-b1eb-299090aee185 tempest-ProjectMemberTests-1277025339 None] Create snapshot completed successfully Jul 07 08:39:57 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:39:57 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Deleted volume successfully. Jul 07 08:39:57 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d737c464-43f7-4d81-985d-3dab8e48dc18 tempest-ProjectReaderTests-647648734 None] Lock "cinder-9a721767-9251-4771-af3e-5befc9474701-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (11cab808-1bbe-4f21-b606-d32477624034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7a0331-ea1b-46d4-beca-d2f3801e3e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7a0331-ea1b-46d4-beca-d2f3801e3e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472071926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3090494a-3710-4614-b7f0-63aa916ee6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:58Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60991f69-a0ae-422f-a379-b07228f1c178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60991f69-a0ae-422f-a379-b07228f1c178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3081d7-5abc-47bf-9d25-14bf43cf131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3081d7-5abc-47bf-9d25-14bf43cf131f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3090494a-3710-4614-b7f0-63aa916ee6ab', 'volume_name': 'volume-3090494a-3710-4614-b7f0-63aa916ee6ab', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e06a9e5-f88d-48f8-93da-46a1ce90788c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e06a9e5-f88d-48f8-93da-46a1ce90788c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b30711a-7118-4432-a950-f493515e51a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:39:58 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Volume 3090494a-3710-4614-b7f0-63aa916ee6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3090494a-3710-4614-b7f0-63aa916ee6ab', 'volume_size': 1} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472071926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3090494a-3710-4614-b7f0-63aa916ee6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:39:58Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Creating volume 3090494a-3710-4614-b7f0-63aa916ee6ab {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:39:58 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:58 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab 1073741824 Jul 07 08:39:58 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-d0959737-1c82-4565-bac3-e9d312210589-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Lock "cinder-d0959737-1c82-4565-bac3-e9d312210589-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-8b058003-8f88-45c4-a4cc-21ab92fba668" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-8b058003-8f88-45c4-a4cc-21ab92fba668" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-d0959737-1c82-4565-bac3-e9d312210589" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d0959737-1c82-4565-bac3-e9d312210589" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Deleting offline snapshot d0959737-1c82-4565-bac3-e9d312210589 of volume 8b058003-8f88-45c4-a4cc-21ab92fba668 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] snapshot_file for this snap is: volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c501f7a-7d8c-4413-9e76-984634e8a035]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:58 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 Jul 07 08:39:58 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:59 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab 1073741824" returned: 0 in 0.859s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:59 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab Jul 07 08:39:59 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:59 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589" returned: 0 in 0.750s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b058003-8f88-45c4-a4cc-21ab92fba668(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2d1a4a-1a7a-4602-83ff-2822298a664f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:39:59 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 Jul 07 08:39:59 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:39:59 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab" returned: 0 in 0.639s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b30711a-7118-4432-a950-f493515e51a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3090494a-3710-4614-b7f0-63aa916ee6ab', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:39:59 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd18c29-e6d3-4657-9c77-f8d6e411c141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:00 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Volume volume-3090494a-3710-4614-b7f0-63aa916ee6ab (3090494a-3710-4614-b7f0-63aa916ee6ab): created successfully Jul 07 08:40:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd18c29-e6d3-4657-9c77-f8d6e411c141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:00 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (11cab808-1bbe-4f21-b606-d32477624034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:00 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-0417deda-48c7-40c1-bac2-df678014200d tempest-ProjectReaderTests-647648734 None] Created volume successfully. Jul 07 08:40:00 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668" returned: 0 in 0.737s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:00 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 Jul 07 08:40:00 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:00 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Creating offline snapshot 2239aa84-801d-410f-bca9-2b8b16df5937 of volume 3090494a-3710-4614-b7f0-63aa916ee6ab {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:40:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e71b6-6bfd-433b-ab03-4b59a2182a72]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:00 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab Jul 07 08:40:00 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:01 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589" returned: 0 in 0.726s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:01 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589 Jul 07 08:40:01 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:01 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab" returned: 0 in 0.733s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:01 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 1G Jul 07 08:40:01 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:01 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668.d0959737-1c82-4565-bac3-e9d312210589" returned: 0 in 0.668s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d0959737-1c82-4565-bac3-e9d312210589" released by "_delete_snapshot" :: held 2.978s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-8b058003-8f88-45c4-a4cc-21ab92fba668" released by "delete_snapshot" :: held 3.001s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Created reservations ['bbf9f0fb-c26b-44f1-a6f5-7d734f9f074f', '8cf61336-33e1-4162-82f4-3606ba3ff037', '6f593d79-00ed-4919-b43b-77aa739b7359', 'f32ced69-f399-4099-be84-e12fb62f036c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:01 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Delete snapshot completed successfully. Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-090031b6-9210-4d0f-9866-62ea04521cca tempest-ProjectMemberTests-1277025339 None] Lock "cinder-d0959737-1c82-4565-bac3-e9d312210589-delete_snapshot" released by "delete_snapshot" :: held 3.145s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-8b058003-8f88-45c4-a4cc-21ab92fba668-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-8b058003-8f88-45c4-a4cc-21ab92fba668-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-8b058003-8f88-45c4-a4cc-21ab92fba668" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:01 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-8b058003-8f88-45c4-a4cc-21ab92fba668" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:02 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde504e9-88b5-42c4-8f8b-555cd93c0998]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:02 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 Jul 07 08:40:02 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:02 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 1G" returned: 0 in 0.854s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3090494a-3710-4614-b7f0-63aa916ee6ab -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:02 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3090494a-3710-4614-b7f0-63aa916ee6ab -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 Jul 07 08:40:02 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:02 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668" returned: 0 in 0.777s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:02 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668 Jul 07 08:40:02 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:02 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3090494a-3710-4614-b7f0-63aa916ee6ab -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937" returned: 0 in 0.701s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:02 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 is being set with open permissions: ugo+rw Jul 07 08:40:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:02 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 Jul 07 08:40:02 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:03 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-8b058003-8f88-45c4-a4cc-21ab92fba668" returned: 0 in 0.647s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-8b058003-8f88-45c4-a4cc-21ab92fba668" released by "delete_volume" :: held 1.481s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=107,cinder:INSERT=39,cinder:UPDATE=142,cinder:DELETE=12 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Created reservations ['44a2c6c9-a1d9-4153-bf72-873776bf7140', '5c2a84ed-da8f-431c-9081-46c69e6c54b2', '4125a44c-4544-47e1-aad1-da36d3ba5a8b', 'b9f5b581-d0c3-4825-8f22-ff864a141056'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:03 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937" returned: 0 in 0.677s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:03 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:40:03 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:03 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.info Jul 07 08:40:03 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:04 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.659s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:40:04 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Deleted volume successfully. Jul 07 08:40:04 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.info" returned: 0 in 0.661s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:04 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.info is being set with open permissions: ugo+rw Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6c8c8b4e-3708-4448-a448-6ead39368665 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-8b058003-8f88-45c4-a4cc-21ab92fba668-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:04 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.info Jul 07 08:40:04 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (67cc06a5-1ffb-4f1e-a63e-a0edb62a96af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0b24fa-0916-42b9-91f0-fe92b192e907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0b24fa-0916-42b9-91f0-fe92b192e907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747583940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:05Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:04 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:40:04 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea8e39d-1c30-43ec-959f-cb5ed74d6edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea8e39d-1c30-43ec-959f-cb5ed74d6edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e6bc39-f169-4f86-abb4-ee0e26d452ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e6bc39-f169-4f86-abb4-ee0e26d452ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2205885-c1ce-4e2d-b0b9-0c2327bfa6d6', 'volume_name': 'volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7242da2c-e3fd-4a7c-aeb6-c6aa4f9baaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7242da2c-e3fd-4a7c-aeb6-c6aa4f9baaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e5cf2e-db4f-4976-864c-46975fac6135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:04 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Volume d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6', 'volume_size': 1} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:04 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.info" returned: 0 in 0.626s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.334s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.207s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747583940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:05Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Creating volume d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:40:04 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:40:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:04 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 1073741824 Jul 07 08:40:04 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:04 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-c1b78260-c7bf-455a-af99-084d558026e9 tempest-ProjectReaderTests-647648734 None] Create snapshot completed successfully Jul 07 08:40:05 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.648s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:40:05 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 1073741824" returned: 0 in 0.780s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:05 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 Jul 07 08:40:05 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-2239aa84-801d-410f-bca9-2b8b16df5937-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Lock "cinder-2239aa84-801d-410f-bca9-2b8b16df5937-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-3090494a-3710-4614-b7f0-63aa916ee6ab" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-3090494a-3710-4614-b7f0-63aa916ee6ab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-2239aa84-801d-410f-bca9-2b8b16df5937" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-2239aa84-801d-410f-bca9-2b8b16df5937" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Deleting offline snapshot 2239aa84-801d-410f-bca9-2b8b16df5937 of volume 3090494a-3710-4614-b7f0-63aa916ee6ab {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] snapshot_file for this snap is: volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[74313b46-dc29-4307-96b1-20934d4ee805]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:06 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 Jul 07 08:40:06 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:06 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" returned: 0 in 0.650s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e5cf2e-db4f-4976-864c-46975fac6135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9333ceb8-f3ca-4725-a0d3-39a14e5d2cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:06 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Volume volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 (d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6): created successfully Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9333ceb8-f3ca-4725-a0d3-39a14e5d2cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (67cc06a5-1ffb-4f1e-a63e-a0edb62a96af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:06 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-88bf6ff8-36d2-437e-b322-d3ceeef26979 tempest-ProjectMemberTests-1277025339 None] Created volume successfully. Jul 07 08:40:06 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937" returned: 0 in 0.753s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3090494a-3710-4614-b7f0-63aa916ee6ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6fcd55-cc7e-4fd5-a160-440fe72a81e4]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:06 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab Jul 07 08:40:06 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Creating offline snapshot f688a5b5-5207-4ff8-b059-6bda48076cb5 of volume d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df330d7-0593-4bfe-ae97-5580b6d952e9]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:06 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:07 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 Jul 07 08:40:07 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:07 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab" returned: 0 in 0.748s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:07 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 Jul 07 08:40:07 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:07 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" returned: 0 in 0.753s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:07 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:07 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 1G Jul 07 08:40:07 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:08 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937" returned: 0 in 0.742s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:08 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937 Jul 07 08:40:08 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:08 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 1G" returned: 0 in 0.794s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:08 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 Jul 07 08:40:08 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:08 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:08 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab.2239aa84-801d-410f-bca9-2b8b16df5937" returned: 0 in 0.625s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-2239aa84-801d-410f-bca9-2b8b16df5937" released by "_delete_snapshot" :: held 2.966s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-3090494a-3710-4614-b7f0-63aa916ee6ab" released by "delete_snapshot" :: held 2.994s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:08 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Created reservations ['9aefec7b-83af-4f46-825a-5c5bea88834c', 'd2961adf-b3db-4b6f-9a8e-7fdb3c77a79a', '84006a51-7262-401a-8b47-7fa47433d619', '4cf8585d-a7da-4916-a806-cd824e48193e'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:08 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Delete snapshot completed successfully. Jul 07 08:40:08 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f458644b-07ff-42ae-9083-0cd4a631b66e tempest-ProjectReaderTests-647648734 None] Lock "cinder-2239aa84-801d-410f-bca9-2b8b16df5937-delete_snapshot" released by "delete_snapshot" :: held 3.143s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-3090494a-3710-4614-b7f0-63aa916ee6ab-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Lock "cinder-3090494a-3710-4614-b7f0-63aa916ee6ab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-3090494a-3710-4614-b7f0-63aa916ee6ab" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-3090494a-3710-4614-b7f0-63aa916ee6ab" acquired by "delete_volume" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:09 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5" returned: 0 in 0.709s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:09 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 is being set with open permissions: ugo+rw Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c264e-edfd-4ea4-b422-fcec174bdd03]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:09 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 Jul 07 08:40:09 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:09 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab Jul 07 08:40:09 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:09 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5" returned: 0 in 0.631s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:09 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.info Jul 07 08:40:09 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:09 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab" returned: 0 in 0.756s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:09 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:09 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab Jul 07 08:40:09 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:10 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.info" returned: 0 in 0.724s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:10 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.info is being set with open permissions: ugo+rw Jul 07 08:40:10 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-3090494a-3710-4614-b7f0-63aa916ee6ab" returned: 0 in 0.636s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:10 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.info Jul 07 08:40:10 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-3090494a-3710-4614-b7f0-63aa916ee6ab" released by "delete_volume" :: held 1.452s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Created reservations ['2c8444c8-fbb2-41c6-ab68-f1b551776151', '78623703-1462-4db1-8c0e-733bac993c19', 'd4f5effc-dd34-4cda-9ca6-43090d6a25f4', '6e42df6d-ff59-4b38-9903-885cc150898b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:10 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:10 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:40:10 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:11 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.info" returned: 0 in 0.615s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.318s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:11 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-73fe47e8-adc8-4780-8b1e-d6e200324471 tempest-ProjectMemberTests-1277025339 None] Create snapshot completed successfully Jul 07 08:40:11 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.653s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:40:11 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Deleted volume successfully. Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-48ecea67-16ad-43b9-9bef-527f02080326 tempest-ProjectReaderTests-647648734 None] Lock "cinder-3090494a-3710-4614-b7f0-63aa916ee6ab-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (3884ce0e-fd9b-45b8-9c9c-ddff44687c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875b62fb-d088-42a9-a7a1-194b66ad8687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875b62fb-d088-42a9-a7a1-194b66ad8687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-751976016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246de6ba-79dc-4bab-af42-dcec4a43f199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:12Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e530044e-3a93-4fd5-9a0f-6b17c74e957c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e530044e-3a93-4fd5-9a0f-6b17c74e957c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607c3ec4-44c7-419f-a4d4-7e647b417526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607c3ec4-44c7-419f-a4d4-7e647b417526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '246de6ba-79dc-4bab-af42-dcec4a43f199', 'volume_name': 'volume-246de6ba-79dc-4bab-af42-dcec4a43f199', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642c9775-8bda-48f0-9768-7b3f5cb8dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642c9775-8bda-48f0-9768-7b3f5cb8dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b7f726-0f3b-4f03-91b1-940d049213c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:11 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Volume 246de6ba-79dc-4bab-af42-dcec4a43f199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-246de6ba-79dc-4bab-af42-dcec4a43f199', 'volume_size': 1} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-751976016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246de6ba-79dc-4bab-af42-dcec4a43f199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaa48ef1aa4624834e2973cba24721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:12Z,use_quota=True,user_id='0c99b28f64c34d168a8228a6bc98967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Creating volume 246de6ba-79dc-4bab-af42-dcec4a43f199 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:40:11 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:40:11 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:11 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 1073741824 Jul 07 08:40:11 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-f688a5b5-5207-4ff8-b059-6bda48076cb5-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-f688a5b5-5207-4ff8-b059-6bda48076cb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-f688a5b5-5207-4ff8-b059-6bda48076cb5" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-f688a5b5-5207-4ff8-b059-6bda48076cb5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Deleting offline snapshot f688a5b5-5207-4ff8-b059-6bda48076cb5 of volume d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] snapshot_file for this snap is: volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf67522-6e16-4333-ae71-abf2fe924381]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:12 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 Jul 07 08:40:12 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:12 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 1073741824" returned: 0 in 0.808s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:12 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 Jul 07 08:40:12 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:12 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5" returned: 0 in 0.805s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:40:12 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad869aa-6253-44bd-98b1-821311f1974e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:13 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 Jul 07 08:40:13 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:13 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199" returned: 0 in 0.692s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b7f726-0f3b-4f03-91b1-940d049213c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246de6ba-79dc-4bab-af42-dcec4a43f199', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f85cdd-881a-4603-8f00-cffe4d0590ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:13 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Volume volume-246de6ba-79dc-4bab-af42-dcec4a43f199 (246de6ba-79dc-4bab-af42-dcec4a43f199): created successfully Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f85cdd-881a-4603-8f00-cffe4d0590ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Flow 'volume_create_manager' (3884ce0e-fd9b-45b8-9c9c-ddff44687c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:13 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3d88d7a0-0d96-48de-9883-6bca70282dd7 tempest-ProjectReaderTests-647648734 None] Created volume successfully. Jul 07 08:40:13 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" returned: 0 in 0.790s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:13 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 Jul 07 08:40:13 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Creating offline snapshot ce676587-b334-45b8-83e1-381fcb1b8751 of volume 246de6ba-79dc-4bab-af42-dcec4a43f199 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e917521-5b85-4307-8fb2-70f612be0ac3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:13 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:14 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 Jul 07 08:40:14 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:14 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5" returned: 0 in 0.712s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:14 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5 Jul 07 08:40:14 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:14 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199" returned: 0 in 0.805s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:14 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:14 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 1G Jul 07 08:40:14 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:15 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6.f688a5b5-5207-4ff8-b059-6bda48076cb5" returned: 0 in 0.636s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-f688a5b5-5207-4ff8-b059-6bda48076cb5" released by "_delete_snapshot" :: held 3.049s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" released by "delete_snapshot" :: held 3.077s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:15 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Created reservations ['cd8c5b35-af95-4960-872f-b6ee2cc933f7', 'afa442ea-a7ad-4076-9ca8-3b04967f7584', 'e8b25125-68e5-4706-9bec-28062b16ee44', '28e1a36a-2bb1-4556-b995-dbf7aa4d4074'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:15 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Delete snapshot completed successfully. Jul 07 08:40:15 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-67128f65-4e80-424f-bf24-9d31f8e96931 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-f688a5b5-5207-4ff8-b059-6bda48076cb5-delete_snapshot" released by "delete_snapshot" :: held 3.219s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:15 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 1G" returned: 0 in 0.767s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:15 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-246de6ba-79dc-4bab-af42-dcec4a43f199 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:15 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-246de6ba-79dc-4bab-af42-dcec4a43f199 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 Jul 07 08:40:15 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:16 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-246de6ba-79dc-4bab-af42-dcec4a43f199 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751" returned: 0 in 0.661s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:16 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 is being set with open permissions: ugo+rw Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:16 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 Jul 07 08:40:16 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b30248-cf30-4391-bb02-f42b693608ab]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:16 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 Jul 07 08:40:16 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:16 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751" returned: 0 in 0.638s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:16 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:16 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.info Jul 07 08:40:16 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:17 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" returned: 0 in 0.758s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:17 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6 Jul 07 08:40:17 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:17 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.info" returned: 0 in 0.672s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:17 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.info is being set with open permissions: ugo+rw Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:17 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.info Jul 07 08:40:17 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:17 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" returned: 0 in 0.628s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6" released by "delete_volume" :: held 1.447s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Created reservations ['deab22b0-91b8-4982-a804-bc890810e428', 'b581fcce-d4ea-46e9-afa2-1ee098f30abb', '037aa621-fc6d-49a6-a8af-696f5a9439b9', 'e4edc3f5-fd5f-4991-ba3f-b1dbd9a5ed39'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:17 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:18 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:40:18 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:18 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.info" returned: 0 in 0.644s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:18 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ded949f9-ca65-43a3-b3eb-9ac4d2342cae tempest-ProjectReaderTests-647648734 None] Create snapshot completed successfully Jul 07 08:40:18 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:18 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.650s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:18 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:40:18 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Deleted volume successfully. Jul 07 08:40:18 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-405ed14a-faf6-4816-aec3-e3e2c6f42ff2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-d2205885-c1ce-4e2d-b0b9-0c2327bfa6d6-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (33b1c096-155a-4354-b526-4fbf4b9b1c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ea208f-caee-4a55-9960-68c024964f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ea208f-caee-4a55-9960-68c024964f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799998262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1390b398-57a4-414d-872b-e38c9a5d8062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:19Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9861495c-fe64-40c1-bee0-a18e5b859ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9861495c-fe64-40c1-bee0-a18e5b859ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813b3190-8d49-49bf-8bdc-53171ce1583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813b3190-8d49-49bf-8bdc-53171ce1583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1390b398-57a4-414d-872b-e38c9a5d8062', 'volume_name': 'volume-1390b398-57a4-414d-872b-e38c9a5d8062', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3d3f22-305e-4a5d-8cca-424b4cbcf7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3d3f22-305e-4a5d-8cca-424b4cbcf7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a934bc7-b93c-43bc-9368-34e65cdd7eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:19 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Volume 1390b398-57a4-414d-872b-e38c9a5d8062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1390b398-57a4-414d-872b-e38c9a5d8062', 'volume_size': 1} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799998262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1390b398-57a4-414d-872b-e38c9a5d8062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:19Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Creating volume 1390b398-57a4-414d-872b-e38c9a5d8062 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:40:19 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-ce676587-b334-45b8-83e1-381fcb1b8751-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:19 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 1073741824 Jul 07 08:40:19 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Lock "cinder-ce676587-b334-45b8-83e1-381fcb1b8751-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-246de6ba-79dc-4bab-af42-dcec4a43f199" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-246de6ba-79dc-4bab-af42-dcec4a43f199" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-ce676587-b334-45b8-83e1-381fcb1b8751" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-ce676587-b334-45b8-83e1-381fcb1b8751" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Deleting offline snapshot ce676587-b334-45b8-83e1-381fcb1b8751 of volume 246de6ba-79dc-4bab-af42-dcec4a43f199 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] snapshot_file for this snap is: volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de7a4d-783b-44b7-9233-ec2ab6359b4b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:19 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 Jul 07 08:40:19 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:19 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:19 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 1073741824" returned: 0 in 0.837s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:19 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751" returned: 0 in 0.766s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-246de6ba-79dc-4bab-af42-dcec4a43f199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[660b8f88-d31b-4c92-9d7f-092483a531dc]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:20 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 Jul 07 08:40:20 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:20 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 Jul 07 08:40:20 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:20 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062" returned: 0 in 0.682s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a934bc7-b93c-43bc-9368-34e65cdd7eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1390b398-57a4-414d-872b-e38c9a5d8062', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b112e28-fe78-4842-9fff-4c3e4a580775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:20 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Volume volume-1390b398-57a4-414d-872b-e38c9a5d8062 (1390b398-57a4-414d-872b-e38c9a5d8062): created successfully Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b112e28-fe78-4842-9fff-4c3e4a580775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (33b1c096-155a-4354-b526-4fbf4b9b1c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:20 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9b8b2ef4-6b69-4136-9d05-1f53624d1dbd tempest-ProjectMemberTests-1277025339 None] Created volume successfully. Jul 07 08:40:20 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199" returned: 0 in 0.747s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:20 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:20 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 Jul 07 08:40:20 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:21 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Creating offline snapshot 384b0330-8b73-47de-8e1c-075cde9e3ca5 of volume 1390b398-57a4-414d-872b-e38c9a5d8062 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:40:21 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6f629-0303-492b-b95a-daae264f506f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:21 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 Jul 07 08:40:21 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:21 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751" returned: 0 in 0.735s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:21 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:21 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751 Jul 07 08:40:21 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:22 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062" returned: 0 in 0.822s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:22 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199.ce676587-b334-45b8-83e1-381fcb1b8751" returned: 0 in 0.671s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:22 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 1G Jul 07 08:40:22 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-ce676587-b334-45b8-83e1-381fcb1b8751" released by "_delete_snapshot" :: held 3.033s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-246de6ba-79dc-4bab-af42-dcec4a43f199" released by "delete_snapshot" :: held 3.063s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:22 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Created reservations ['c47be303-cbef-45cd-b0fc-26c278209896', 'b4bdd59d-cd82-4276-b57d-70cc5fb7f776', 'd5bc6005-21b6-45ec-9c01-d29a485ea0ae', 'e0307693-756b-4bc2-a3a1-0fc7ce321daf'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:22 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Delete snapshot completed successfully. Jul 07 08:40:22 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-9ffb8f63-6610-419c-b885-d465ece15dc8 tempest-ProjectReaderTests-647648734 None] Lock "cinder-ce676587-b334-45b8-83e1-381fcb1b8751-delete_snapshot" released by "delete_snapshot" :: held 3.239s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:22 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 1G" returned: 0 in 0.762s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:22 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1390b398-57a4-414d-872b-e38c9a5d8062 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:22 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1390b398-57a4-414d-872b-e38c9a5d8062 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 Jul 07 08:40:22 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-246de6ba-79dc-4bab-af42-dcec4a43f199-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Lock "cinder-246de6ba-79dc-4bab-af42-dcec4a43f199-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Acquiring lock "cinder-quobyte-246de6ba-79dc-4bab-af42-dcec4a43f199" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:23 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-246de6ba-79dc-4bab-af42-dcec4a43f199" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:23 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d9aa33-52b7-4a00-8f6b-853b73a2a934]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:23 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1390b398-57a4-414d-872b-e38c9a5d8062 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5" returned: 0 in 0.692s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:23 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 is being set with open permissions: ugo+rw Jul 07 08:40:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:23 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 Jul 07 08:40:23 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:23 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 Jul 07 08:40:23 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:24 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5" returned: 0 in 0.626s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:24 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199" returned: 0 in 0.775s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:24 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.info Jul 07 08:40:24 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:24 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199 Jul 07 08:40:24 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:24 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-246de6ba-79dc-4bab-af42-dcec4a43f199" returned: 0 in 0.620s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:24 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Lock "cinder-quobyte-246de6ba-79dc-4bab-af42-dcec4a43f199" released by "delete_volume" :: held 1.458s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Created reservations ['472dbc1f-2a70-43aa-9e66-2ce72e0b2d0a', '88dcc1e2-bed5-4c18-8842-56cd01486ca6', '2c55d493-0852-4f50-9898-bf21c4fee044', '77f21421-8e1c-4500-836b-cc75e956eb7b'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:25 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.info" returned: 0 in 0.740s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:25 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.info is being set with open permissions: ugo+rw Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:25 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.info Jul 07 08:40:25 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:25 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:40:25 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:25 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.info" returned: 0 in 0.683s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.425s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:25 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.672s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:40:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Deleted volume successfully. Jul 07 08:40:25 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-98a6e23b-21b7-45bb-b01a-35683565aeea tempest-ProjectMemberTests-1277025339 None] Create snapshot completed successfully Jul 07 08:40:25 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-d009a471-8be0-4f20-9c03-5a6316880a3e tempest-ProjectReaderTests-647648734 None] Lock "cinder-246de6ba-79dc-4bab-af42-dcec4a43f199-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-384b0330-8b73-47de-8e1c-075cde9e3ca5-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-384b0330-8b73-47de-8e1c-075cde9e3ca5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-1390b398-57a4-414d-872b-e38c9a5d8062" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-1390b398-57a4-414d-872b-e38c9a5d8062" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-384b0330-8b73-47de-8e1c-075cde9e3ca5" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-384b0330-8b73-47de-8e1c-075cde9e3ca5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Deleting offline snapshot 384b0330-8b73-47de-8e1c-075cde9e3ca5 of volume 1390b398-57a4-414d-872b-e38c9a5d8062 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] snapshot_file for this snap is: volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce8a193-e0f8-4eee-bbff-e70da30c4757]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:26 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 Jul 07 08:40:26 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:27 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5" returned: 0 in 0.860s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:27 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1390b398-57a4-414d-872b-e38c9a5d8062(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:40:27 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bdcec5-1f6c-44e6-ab88-834e3020c03b]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:27 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 Jul 07 08:40:27 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:28 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062" returned: 0 in 0.767s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:28 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 Jul 07 08:40:28 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:29 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5" returned: 0 in 0.743s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:29 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5 Jul 07 08:40:29 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Flow 'volume_create_manager' (e5ec9c30-7f8d-4dbe-9b84-ff45f6c241db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed10afc-3933-4db5-863b-40a5fc1b2346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed10afc-3933-4db5-863b-40a5fc1b2346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454355022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc902d9e-232f-4ae4-9590-ab4ab530c230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfb5860ecb4cb8949a3a77279ef18a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:29Z,use_quota=True,user_id='6d272a856d5d48959e713fdba53ca784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c239ec-9bc2-4b0f-b133-2d5745fb6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c239ec-9bc2-4b0f-b133-2d5745fb6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc1a84f-a0a2-4c60-9232-7ed2eacd9a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc1a84f-a0a2-4c60-9232-7ed2eacd9a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc902d9e-232f-4ae4-9590-ab4ab530c230', 'volume_name': 'volume-bc902d9e-232f-4ae4-9590-ab4ab530c230', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daf7bfa-085a-41f2-a1ab-1932ac1c3090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daf7bfa-085a-41f2-a1ab-1932ac1c3090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9ea8b7-eb1c-47ef-afa0-480a2e89f2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:29 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Volume bc902d9e-232f-4ae4-9590-ab4ab530c230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc902d9e-232f-4ae4-9590-ab4ab530c230', 'volume_size': 1} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454355022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc902d9e-232f-4ae4-9590-ab4ab530c230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfb5860ecb4cb8949a3a77279ef18a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:29Z,use_quota=True,user_id='6d272a856d5d48959e713fdba53ca784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Creating volume bc902d9e-232f-4ae4-9590-ab4ab530c230 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:40:29 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:29 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 1073741824 Jul 07 08:40:29 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:29 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062.384b0330-8b73-47de-8e1c-075cde9e3ca5" returned: 0 in 0.704s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-384b0330-8b73-47de-8e1c-075cde9e3ca5" released by "_delete_snapshot" :: held 3.183s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-1390b398-57a4-414d-872b-e38c9a5d8062" released by "delete_snapshot" :: held 3.212s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=118,cinder:INSERT=42,cinder:UPDATE=135,cinder:DELETE=10 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Created reservations ['dee6b742-a896-4466-a0ae-f1d1cce13bc2', '965d8a3e-c821-4021-9b58-71f70ac18b1f', 'e377fd42-2160-4cda-b327-0ae73b7b0351', '180a7c7d-e188-4a74-b9c4-62d058798738'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Delete snapshot completed successfully. Jul 07 08:40:29 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f099f62d-ad68-4805-9b44-9d9f6ed9f7f2 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-384b0330-8b73-47de-8e1c-075cde9e3ca5-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:30 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 1073741824" returned: 0 in 0.831s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:30 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 Jul 07 08:40:30 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-1390b398-57a4-414d-872b-e38c9a5d8062-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-1390b398-57a4-414d-872b-e38c9a5d8062-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-1390b398-57a4-414d-872b-e38c9a5d8062" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:30 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-1390b398-57a4-414d-872b-e38c9a5d8062" acquired by "delete_volume" :: waited 0.021s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:30 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[63434021-4fb9-4c95-a056-99c253280eff]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:30 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:31 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 Jul 07 08:40:31 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:31 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230" returned: 0 in 0.630s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9ea8b7-eb1c-47ef-afa0-480a2e89f2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc902d9e-232f-4ae4-9590-ab4ab530c230', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63f6a6a-c126-4bc0-bbac-e9e1b6e026f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Volume volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 (bc902d9e-232f-4ae4-9590-ab4ab530c230): created successfully Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63f6a6a-c126-4bc0-bbac-e9e1b6e026f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Flow 'volume_create_manager' (e5ec9c30-7f8d-4dbe-9b84-ff45f6c241db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:31 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-267e7321-3d92-47ee-b437-b672ea0e4185 tempest-ProjectReaderTests-2053086924 None] Created volume successfully. Jul 07 08:40:31 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Acquiring lock "cinder-bc902d9e-232f-4ae4-9590-ab4ab530c230-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062" returned: 0 in 0.764s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Lock "cinder-bc902d9e-232f-4ae4-9590-ab4ab530c230-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:31 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062 Jul 07 08:40:31 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Acquiring lock "cinder-quobyte-bc902d9e-232f-4ae4-9590-ab4ab530c230" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Lock "cinder-quobyte-bc902d9e-232f-4ae4-9590-ab4ab530c230" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62df8bf-0633-4d68-bb1c-850dbba04c09]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:31 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 Jul 07 08:40:31 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:32 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-1390b398-57a4-414d-872b-e38c9a5d8062" returned: 0 in 0.664s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-1390b398-57a4-414d-872b-e38c9a5d8062" released by "delete_volume" :: held 1.487s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Created reservations ['6e14f5b7-a2e0-40c6-9440-8bc5d8e098eb', 'f95cb200-c8df-477e-8de3-3c0ca12c8ad7', 'f0f866e5-fac3-4548-b972-0eb534fb2b28', '4ab400af-7353-4d3a-9664-bcad56896bd8'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:32 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:40:32 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:32 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230" returned: 0 in 0.764s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:32 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230 Jul 07 08:40:32 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:33 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.645s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:40:33 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Deleted volume successfully. Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-f4fcede8-b341-43ea-8c44-741d87c06c42 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-1390b398-57a4-414d-872b-e38c9a5d8062-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:33 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-bc902d9e-232f-4ae4-9590-ab4ab530c230" returned: 0 in 0.653s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Lock "cinder-quobyte-bc902d9e-232f-4ae4-9590-ab4ab530c230" released by "delete_volume" :: held 1.457s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Created reservations ['84680ab2-c2c0-42c2-bd10-8ef03010afae', '9bcb8183-4c71-4743-99cd-540724c17e7e', '024c7633-1388-458d-a6a8-81754a709647', 'e0f730bf-6b14-442e-b5a9-8a8f10c8c30c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:33 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:40:33 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (ea41c08a-3211-4f19-90a0-ae9587ebaad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2334e224-c1fc-4409-8941-9a2550a02cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2334e224-c1fc-4409-8941-9a2550a02cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161470933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10982305-5052-4414-8118-856c7fbbc96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:34Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2e36e2-70a7-41a2-9c84-21555ba03ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2e36e2-70a7-41a2-9c84-21555ba03ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a54c1ba-519b-4c8f-aa65-60cec2eb0810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a54c1ba-519b-4c8f-aa65-60cec2eb0810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10982305-5052-4414-8118-856c7fbbc96d', 'volume_name': 'volume-10982305-5052-4414-8118-856c7fbbc96d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c14f73-db11-4f9d-b53a-7501507b81b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c14f73-db11-4f9d-b53a-7501507b81b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9d6b6a-5dbe-487c-94ec-ca002e464c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:33 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Volume 10982305-5052-4414-8118-856c7fbbc96d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10982305-5052-4414-8118-856c7fbbc96d', 'volume_size': 1} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161470933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10982305-5052-4414-8118-856c7fbbc96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:34Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Creating volume 10982305-5052-4414-8118-856c7fbbc96d {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:40:33 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:40:33 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:33 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d 1073741824 Jul 07 08:40:33 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:34 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.701s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:40:34 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Deleted volume successfully. Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-32fd418a-3f33-4bc4-89be-7cd05dadd5da tempest-ProjectReaderTests-2053086924 None] Lock "cinder-bc902d9e-232f-4ae4-9590-ab4ab530c230-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Flow 'volume_create_manager' (4c9c1383-a350-4ba3-947b-bf12c7fb980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf09502-eefe-4e02-8a63-6b29640f6cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf09502-eefe-4e02-8a63-6b29640f6cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268770026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de90c653-81b6-4d91-b16c-67d695d3b74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfb5860ecb4cb8949a3a77279ef18a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:34Z,use_quota=True,user_id='6d272a856d5d48959e713fdba53ca784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9561de-066d-4a9f-be5b-28e618e3f316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9561de-066d-4a9f-be5b-28e618e3f316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2c6527-0f2b-4a65-9c11-1adcc4a484af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2c6527-0f2b-4a65-9c11-1adcc4a484af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de90c653-81b6-4d91-b16c-67d695d3b74a', 'volume_name': 'volume-de90c653-81b6-4d91-b16c-67d695d3b74a', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d467819c-f4ba-4a23-846d-c8e13a3aecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d467819c-f4ba-4a23-846d-c8e13a3aecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8fc511-5c97-4e1d-b322-e9fdb5ffd2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:34 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Volume de90c653-81b6-4d91-b16c-67d695d3b74a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de90c653-81b6-4d91-b16c-67d695d3b74a', 'volume_size': 1} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:34 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d 1073741824" returned: 0 in 0.875s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:34 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:34 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d Jul 07 08:40:34 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:35 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d" returned: 0 in 0.610s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-268770026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de90c653-81b6-4d91-b16c-67d695d3b74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfb5860ecb4cb8949a3a77279ef18a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:34Z,use_quota=True,user_id='6d272a856d5d48959e713fdba53ca784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Creating volume de90c653-81b6-4d91-b16c-67d695d3b74a {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:40:35 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9d6b6a-5dbe-487c-94ec-ca002e464c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10982305-5052-4414-8118-856c7fbbc96d', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:35 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a 1073741824 Jul 07 08:40:35 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f3da09-7134-4a14-a7d7-97920512b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:35 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Volume volume-10982305-5052-4414-8118-856c7fbbc96d (10982305-5052-4414-8118-856c7fbbc96d): created successfully Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f3da09-7134-4a14-a7d7-97920512b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (ea41c08a-3211-4f19-90a0-ae9587ebaad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:35 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-7fac1830-50ac-48fe-a69d-3bb0bee203f3 tempest-ProjectMemberTests-1277025339 None] Created volume successfully. Jul 07 08:40:35 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:36 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a 1073741824" returned: 0 in 0.879s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:36 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a Jul 07 08:40:36 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:36 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a" returned: 0 in 0.624s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.914s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Creating offline snapshot 0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca of volume 10982305-5052-4414-8118-856c7fbbc96d {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8fc511-5c97-4e1d-b322-e9fdb5ffd2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de90c653-81b6-4d91-b16c-67d695d3b74a', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868214c1-379e-4c61-8917-b48b1d10ceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d24dd6c-e253-4dd2-98ae-a19ecbe19a0e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:36 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Volume volume-de90c653-81b6-4d91-b16c-67d695d3b74a (de90c653-81b6-4d91-b16c-67d695d3b74a): created successfully Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868214c1-379e-4c61-8917-b48b1d10ceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:36 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Flow 'volume_create_manager' (4c9c1383-a350-4ba3-947b-bf12c7fb980c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:36 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3fd96cc9-b09b-4834-abe3-8616ba38e8ee tempest-ProjectReaderTests-2053086924 None] Created volume successfully. Jul 07 08:40:36 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d Jul 07 08:40:36 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Acquiring lock "cinder-de90c653-81b6-4d91-b16c-67d695d3b74a-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:37 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d" returned: 0 in 0.838s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Lock "cinder-de90c653-81b6-4d91-b16c-67d695d3b74a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:37 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca 1G Jul 07 08:40:37 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Acquiring lock "cinder-quobyte-de90c653-81b6-4d91-b16c-67d695d3b74a" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:37 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Lock "cinder-quobyte-de90c653-81b6-4d91-b16c-67d695d3b74a" acquired by "delete_volume" :: waited 0.019s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a91be1-8c12-4bd3-b170-df33370e644e]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:37 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a Jul 07 08:40:37 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:38 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca 1G" returned: 0 in 0.800s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10982305-5052-4414-8118-856c7fbbc96d -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:38 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10982305-5052-4414-8118-856c7fbbc96d -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca Jul 07 08:40:38 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:38 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a" returned: 0 in 0.787s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:38 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a Jul 07 08:40:38 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:39 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10982305-5052-4414-8118-856c7fbbc96d -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca" returned: 0 in 0.655s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:39 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca is being set with open permissions: ugo+rw Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:39 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca Jul 07 08:40:39 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:39 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-de90c653-81b6-4d91-b16c-67d695d3b74a" returned: 0 in 0.703s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Lock "cinder-quobyte-de90c653-81b6-4d91-b16c-67d695d3b74a" released by "delete_volume" :: held 1.540s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Created reservations ['f3e02da9-e3f4-4830-8f13-f496ee0319f0', '0dfde3fe-0f9b-4ef5-89df-3f30edc9ee8c', 'ab27aa5b-e0e5-4528-bd09-9b48794355b6', 'b56ec9bb-2796-4bfd-9504-2ed898777d39'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:39 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:40:39 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:39 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca" returned: 0 in 0.690s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:39 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.info Jul 07 08:40:39 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:40 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.708s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:40 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:40:40 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Deleted volume successfully. Jul 07 08:40:40 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-668c05e8-8a0b-4236-8cbc-3aae339487b1 tempest-ProjectReaderTests-2053086924 None] Lock "cinder-de90c653-81b6-4d91-b16c-67d695d3b74a-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:40 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.info" returned: 0 in 0.693s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:40 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.info is being set with open permissions: ugo+rw Jul 07 08:40:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:40 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.info Jul 07 08:40:40 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:41 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.info" returned: 0 in 0.757s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.550s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:41 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-dcb47cca-055c-45e8-a1ac-8e6661773215 tempest-ProjectMemberTests-1277025339 None] Create snapshot completed successfully Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-10982305-5052-4414-8118-856c7fbbc96d" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-10982305-5052-4414-8118-856c7fbbc96d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Deleting offline snapshot 0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca of volume 10982305-5052-4414-8118-856c7fbbc96d {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] snapshot_file for this snap is: volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[248fc86b-f35e-4b88-b111-727f20db171a]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:42 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca Jul 07 08:40:42 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:42 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca" returned: 0 in 0.762s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:42 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10982305-5052-4414-8118-856c7fbbc96d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:40:43 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd69a5e-e953-4f61-8455-63abba363578]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:43 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d Jul 07 08:40:43 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:43 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d" returned: 0 in 0.760s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:43 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca Jul 07 08:40:43 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:44 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca" returned: 0 in 0.780s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:44 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca Jul 07 08:40:44 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:45 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d.0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca" returned: 0 in 0.624s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca" released by "_delete_snapshot" :: held 3.016s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-10982305-5052-4414-8118-856c7fbbc96d" released by "delete_snapshot" :: held 3.038s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:45 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Created reservations ['3fe9bedc-be79-41c3-aad5-7a60cc87074d', '66a61f7b-bade-4af8-bd87-9fa58b81a00d', '6af034f8-9fb2-4b04-a460-e9191af80acd', '12d759a7-88d2-4f7b-81f3-9c898133080f'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Delete snapshot completed successfully. Jul 07 08:40:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4f5e7b42-d7a7-4bd5-9d4f-6f01aa0c21b8 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-0aeaa5bf-a96b-4a1b-8ecd-74480f80aaca-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-10982305-5052-4414-8118-856c7fbbc96d-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-10982305-5052-4414-8118-856c7fbbc96d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-10982305-5052-4414-8118-856c7fbbc96d" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-10982305-5052-4414-8118-856c7fbbc96d" acquired by "delete_volume" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:46 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f509173-cde3-4af1-b9d3-3cd2207042cb]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:46 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d Jul 07 08:40:46 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:47 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d" returned: 0 in 0.749s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:47 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d Jul 07 08:40:47 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:47 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-10982305-5052-4414-8118-856c7fbbc96d" returned: 0 in 0.626s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-10982305-5052-4414-8118-856c7fbbc96d" released by "delete_volume" :: held 1.434s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Created reservations ['13179b57-0788-4d0d-87a7-36d4864f26f1', '51d6ab4d-be5f-4b07-b3b5-72ae5c7dcc31', '29c2ab9b-83bb-4819-8c37-ddd7913c7f0e', 'bab92b30-9028-43c5-ac79-d2a6b17201a6'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:47 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:40:47 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:48 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:48 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.643s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:48 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:40:48 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Deleted volume successfully. Jul 07 08:40:48 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-2a6fb29c-0b7f-4523-90b5-7c2ee522cc49 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-10982305-5052-4414-8118-856c7fbbc96d-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (e2b107e9-2e3a-4666-ae11-8e8b47d2a96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c9866a-d495-42cd-88ca-5571201a2081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c9866a-d495-42cd-88ca-5571201a2081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942222516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dd57df-2a12-4d30-8398-0de9c4aaade2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:49Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f31653e-29cf-4634-b50f-bef271696849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f31653e-29cf-4634-b50f-bef271696849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bed43d0-971c-4ba1-bbd9-6067c92e6780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bed43d0-971c-4ba1-bbd9-6067c92e6780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0dd57df-2a12-4d30-8398-0de9c4aaade2', 'volume_name': 'volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3816cc27-e385-4468-b564-938e38e649f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3816cc27-e385-4468-b564-938e38e649f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf6a458-2146-42e2-8f42-b77041a1800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:49 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Volume f0dd57df-2a12-4d30-8398-0de9c4aaade2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2', 'volume_size': 1} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942222516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dd57df-2a12-4d30-8398-0de9c4aaade2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d319531534490582ad4262ced2a10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:40:49Z,use_quota=True,user_id='2b346c8a86784eafb95ae4d7dd01db04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Creating volume f0dd57df-2a12-4d30-8398-0de9c4aaade2 {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:40:49 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:49 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 1073741824 Jul 07 08:40:49 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:49 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 1073741824" returned: 0 in 0.806s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:49 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:49 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 Jul 07 08:40:49 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:50 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2" returned: 0 in 0.626s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:50 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:40:50 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf6a458-2146-42e2-8f42-b77041a1800a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f30ff2-c1e6-456c-a069-a9c8fbf40340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:40:50 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Volume volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 (f0dd57df-2a12-4d30-8398-0de9c4aaade2): created successfully Jul 07 08:40:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f30ff2-c1e6-456c-a069-a9c8fbf40340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:40:50 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Flow 'volume_create_manager' (e2b107e9-2e3a-4666-ae11-8e8b47d2a96c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:40:50 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-ae64ce64-11d2-4246-aff9-cc5c221dd181 tempest-ProjectMemberTests-1277025339 None] Created volume successfully. Jul 07 08:40:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:40:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:40:51 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Creating offline snapshot 5703c31d-3e5a-4ddd-b78b-166b09b795cc of volume f0dd57df-2a12-4d30-8398-0de9c4aaade2 {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:40:51 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca4b05-4900-4c38-a3f3-b66bd0f24fe4]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:51 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:51 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 Jul 07 08:40:51 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:52 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2" returned: 0 in 0.755s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:52 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc 1G Jul 07 08:40:52 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:52 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc 1G" returned: 0 in 0.822s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:52 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:52 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc Jul 07 08:40:52 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:53 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc" returned: 0 in 0.719s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:53 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc is being set with open permissions: ugo+rw Jul 07 08:40:53 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:53 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc Jul 07 08:40:53 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:54 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc" returned: 0 in 0.629s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:54 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.info Jul 07 08:40:54 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:54 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.info" returned: 0 in 0.636s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:54 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.info is being set with open permissions: ugo+rw Jul 07 08:40:54 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:54 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.info Jul 07 08:40:54 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:55 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.info" returned: 0 in 0.653s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:55 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.299s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:40:55 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-171aa6ee-8209-4a6b-baf1-a75fec7207f5 tempest-ProjectMemberTests-1277025339 None] Create snapshot completed successfully Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-5703c31d-3e5a-4ddd-b78b-166b09b795cc-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-5703c31d-3e5a-4ddd-b78b-166b09b795cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-f0dd57df-2a12-4d30-8398-0de9c4aaade2" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-f0dd57df-2a12-4d30-8398-0de9c4aaade2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-5703c31d-3e5a-4ddd-b78b-166b09b795cc" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-5703c31d-3e5a-4ddd-b78b-166b09b795cc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Deleting offline snapshot 5703c31d-3e5a-4ddd-b78b-166b09b795cc of volume f0dd57df-2a12-4d30-8398-0de9c4aaade2 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] snapshot_file for this snap is: volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[024929de-9afe-4c59-b400-1e9245ee2ea9]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:56 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:56 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc Jul 07 08:40:56 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:57 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc" returned: 0 in 0.776s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:57 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:40:57 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f89bf-8bbc-40d7-b1c7-f418cb802945]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:40:57 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:57 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 Jul 07 08:40:57 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:58 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2" returned: 0 in 0.778s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:58 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc Jul 07 08:40:58 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:58 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc" returned: 0 in 0.744s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:58 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:40:59 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc Jul 07 08:40:59 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:40:59 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Jul 07 08:40:59 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2.5703c31d-3e5a-4ddd-b78b-166b09b795cc" returned: 0 in 0.645s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:40:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-5703c31d-3e5a-4ddd-b78b-166b09b795cc" released by "_delete_snapshot" :: held 3.031s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-f0dd57df-2a12-4d30-8398-0de9c4aaade2" released by "delete_snapshot" :: held 3.053s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:40:59 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Created reservations ['1a4a5d53-3173-4952-87af-5d648936c809', 'd7825306-0cdb-479f-a4a8-8267b49881d3', '941a1b43-e89f-4d22-8737-8940933b71d2', '073c4764-ff7c-4ed7-a9ee-32a5a556318c'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:40:59 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Delete snapshot completed successfully. Jul 07 08:40:59 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-4e5210d3-6114-4263-ad25-b4d1f8b82b33 tempest-ProjectMemberTests-1277025339 None] Lock "cinder-5703c31d-3e5a-4ddd-b78b-166b09b795cc-delete_snapshot" released by "delete_snapshot" :: held 3.195s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-f0dd57df-2a12-4d30-8398-0de9c4aaade2-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Lock "cinder-f0dd57df-2a12-4d30-8398-0de9c4aaade2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Acquiring lock "cinder-quobyte-f0dd57df-2a12-4d30-8398-0de9c4aaade2" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:00 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-f0dd57df-2a12-4d30-8398-0de9c4aaade2" acquired by "delete_volume" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:00 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3470cd78-844c-4c1a-ae91-29fff75fbfcb]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:41:00 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:01 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 Jul 07 08:41:01 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:01 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2" returned: 0 in 0.777s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:01 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:01 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2 Jul 07 08:41:01 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:02 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-f0dd57df-2a12-4d30-8398-0de9c4aaade2" returned: 0 in 0.718s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:02 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Lock "cinder-quobyte-f0dd57df-2a12-4d30-8398-0de9c4aaade2" released by "delete_volume" :: held 1.548s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:02 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Created reservations ['e1fde252-2780-462a-b9ec-049a52b3e11d', 'dd539777-2d4a-4508-a541-7747a4c200ce', '349c73d5-9726-47c3-a318-3e03ec1ffcff', 'fbb21a98-c13e-4d3e-94bb-7d88ac8e4720'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:41:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:41:02 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:41:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:02 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:02 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:41:02 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:03 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:03 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.717s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:03 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:41:03 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Deleted volume successfully. Jul 07 08:41:03 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-6b937b01-326a-4685-922c-9567d82af2ab tempest-ProjectMemberTests-1277025339 None] Lock "cinder-f0dd57df-2a12-4d30-8398-0de9c4aaade2-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:41:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:41:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:41:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:04 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:41:04 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:05 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.644s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:41:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:41:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:41:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 08:41:12 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:INSERT=17,cinder:UPDATE=71,cinder:SELECT=43,cinder:DELETE=5 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:41:13 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=103,cinder:INSERT=37,cinder:UPDATE=140,cinder:DELETE=14 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Flow 'volume_create_manager' (f6769002-2403-41be-90ec-6466736635dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865e9121-5b35-4a12-b287-836631358a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865e9121-5b35-4a12-b287-836631358a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2376799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0d5f6a-e254-4626-a67a-8559de3316bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf3d2580bce4a2dbebc6f5537acb4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:41:23Z,use_quota=True,user_id='6ba6244f22df499aafb022ecd063a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb7e91f-e7b0-4f5f-9fcf-a64d05785174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb7e91f-e7b0-4f5f-9fcf-a64d05785174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd8cc4f-8cff-4507-8f32-f1f6116bec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd8cc4f-8cff-4507-8f32-f1f6116bec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d0d5f6a-e254-4626-a67a-8559de3316bb', 'volume_name': 'volume-6d0d5f6a-e254-4626-a67a-8559de3316bb', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5508a4d-2743-47d8-8e1c-96fc5a11034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5508a4d-2743-47d8-8e1c-96fc5a11034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97df200e-2826-4f28-bd73-8a91b989f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:23 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Volume 6d0d5f6a-e254-4626-a67a-8559de3316bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d0d5f6a-e254-4626-a67a-8559de3316bb', 'volume_size': 1} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2376799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0d5f6a-e254-4626-a67a-8559de3316bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf3d2580bce4a2dbebc6f5537acb4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:41:23Z,use_quota=True,user_id='6ba6244f22df499aafb022ecd063a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)}" {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Creating volume 6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:41:23 devstack cinder-volume[87179]: INFO cinder.volume.drivers.remotefs [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] casted to osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 Jul 07 08:41:23 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb 1073741824 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:23 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb 1073741824 Jul 07 08:41:23 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:24 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb 1073741824" returned: 0 in 0.857s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:24 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb Jul 07 08:41:24 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:24 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb" returned: 0 in 0.614s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:24 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'} {{(pid=87179) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 08:41:24 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97df200e-2826-4f28-bd73-8a91b989f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d0d5f6a-e254-4626-a67a-8559de3316bb', 'volume_size': 1}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c5ce59-75b8-4221-bf12-883c8a938078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:24 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Volume volume-6d0d5f6a-e254-4626-a67a-8559de3316bb (6d0d5f6a-e254-4626-a67a-8559de3316bb): created successfully Jul 07 08:41:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c5ce59-75b8-4221-bf12-883c8a938078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:24 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Flow 'volume_create_manager' (f6769002-2403-41be-90ec-6466736635dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:41:24 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b54f17c4-8b7a-4d43-b76e-860c06a20400 tempest-SnapshotDependencyTests-1722452088 None] Created volume successfully. Jul 07 08:41:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:25 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Creating offline snapshot b6ecc921-357a-4e98-ad95-02cbc651ce06 of volume 6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 08:41:25 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[6588d481-f530-47ab-9ca8-8f3d43c3b4a2]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:41:25 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:25 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb Jul 07 08:41:25 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:26 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb" returned: 0 in 0.719s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 1G {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:26 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 1G Jul 07 08:41:26 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:26 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 1G" returned: 0 in 0.760s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:26 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0d5f6a-e254-4626-a67a-8559de3316bb -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:26 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0d5f6a-e254-4626-a67a-8559de3316bb -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 Jul 07 08:41:26 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:27 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d0d5f6a-e254-4626-a67a-8559de3316bb -F qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06" returned: 0 in 0.682s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:27 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 is being set with open permissions: ugo+rw Jul 07 08:41:27 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:27 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 Jul 07 08:41:27 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:28 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06" returned: 0 in 0.610s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:28 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.info Jul 07 08:41:28 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:28 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.info" returned: 0 in 0.626s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:28 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.info is being set with open permissions: ugo+rw Jul 07 08:41:28 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.info {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:28 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.info Jul 07 08:41:28 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:29 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.info" returned: 0 in 0.617s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:29 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.101s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:29 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-48336808-4840-462b-aa02-51368b194c40 tempest-SnapshotDependencyTests-1722452088 None] Create snapshot completed successfully Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.flows.manager.create_volume [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87179) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Flow 'volume_create_manager' (d228b67e-4b24-49cb-a45d-300ea8a88ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297413d7-5015-48aa-a8d7-ad8dd3e52c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297413d7-5015-48aa-a8d7-ad8dd3e52c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T06:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a92c53e-9a67-4763-83f8-78bb807d42cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf3d2580bce4a2dbebc6f5537acb4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T06:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6ecc921-357a-4e98-ad95-02cbc651ce06,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T06:41:31Z,use_quota=True,user_id='6ba6244f22df499aafb022ecd063a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea74a19-545a-4da0-9d4e-8349182ab9c7),volume_type_id=2ea74a19-545a-4da0-9d4e-8349182ab9c7)' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e0f33f-2a15-4e75-8874-08251f5f0d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e0f33f-2a15-4e75-8874-08251f5f0d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0acb1049-6214-4c1f-8b96-31c06ecb2688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0acb1049-6214-4c1f-8b96-31c06ecb2688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a92c53e-9a67-4763-83f8-78bb807d42cf', 'volume_name': 'volume-9a92c53e-9a67-4763-83f8-78bb807d42cf', 'volume_size': 1, 'snapshot_id': 'b6ecc921-357a-4e98-ad95-02cbc651ce06'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1018aca8-e86f-40ae-a3b0-9b81fe0bbdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1018aca8-e86f-40ae-a3b0-9b81fe0bbdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4fa6a3-f8d9-4c8b-8ce3-c6c37af6ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:31 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Volume 9a92c53e-9a67-4763-83f8-78bb807d42cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a92c53e-9a67-4763-83f8-78bb807d42cf', 'volume_size': 1, 'snapshot_id': 'b6ecc921-357a-4e98-ad95-02cbc651ce06'} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "cinder-quobyte-b6ecc921-357a-4e98-ad95-02cbc651ce06-9a92c53e-9a67-4763-83f8-78bb807d42cf" by "_create_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-b6ecc921-357a-4e98-ad95-02cbc651ce06-9a92c53e-9a67-4763-83f8-78bb807d42cf" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Creating volume 9a92c53e-9a67-4763-83f8-78bb807d42cf from snapshot b6ecc921-357a-4e98-ad95-02cbc651ce06 {{(pid=87179) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Selected osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959 as target Quobyte volume. {{(pid=87179) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "cinder-quobyte-9a92c53e-9a67-4763-83f8-78bb807d42cf" by "_copy_volume_from_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-9a92c53e-9a67-4763-83f8-78bb807d42cf" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] snapshot: b6ecc921-357a-4e98-ad95-02cbc651ce06, volume: 9a92c53e-9a67-4763-83f8-78bb807d42cf, {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa785d0-71fb-40ae-9262-7d8bb39c0e40]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:31 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 Jul 07 08:41:31 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:31 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06" returned: 0 in 0.744s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d0d5f6a-e254-4626-a67a-8559de3316bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] will copy from snapshot at /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 08:41:31 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Creating direct copy from snapshot {{(pid=87179) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 08:41:32 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[246f5462-5322-4f1f-89c7-ed4f4a24da11]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:41:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:32 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb Jul 07 08:41:32 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:32 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb" returned: 0 in 0.768s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:32 devstack cinder-volume[87179]: DEBUG cinder.utils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Path /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf not found in is_blk_device check {{(pid=87179) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 08:41:32 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:32 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf Jul 07 08:41:32 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:37 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf" returned: 0 in 4.276s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:37 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0460995-9360-4c22-b4b9-d064b44f806f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:41:37 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:37 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb Jul 07 08:41:37 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:38 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb" returned: 0 in 0.949s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG cinder.image.image_utils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Image conversion details: src /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf {{(pid=87179) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 08:41:38 devstack cinder-volume[87179]: INFO cinder.image.image_utils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Converted 1024.00 MB image at 239.41 MB/s Jul 07 08:41:38 devstack cinder-volume[87179]: WARNING cinder.volume.drivers.remotefs [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf is being set with open permissions: ugo+rw Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:38 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf Jul 07 08:41:38 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:38 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf" returned: 0 in 0.658s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-9a92c53e-9a67-4763-83f8-78bb807d42cf" released by "_copy_volume_from_snapshot" :: held 7.486s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-b6ecc921-357a-4e98-ad95-02cbc651ce06-9a92c53e-9a67-4763-83f8-78bb807d42cf" released by "_create_volume_from_snapshot" :: held 7.513s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.527s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4fa6a3-f8d9-4c8b-8ce3-c6c37af6ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a92c53e-9a67-4763-83f8-78bb807d42cf', 'volume_size': 1, 'snapshot_id': 'b6ecc921-357a-4e98-ad95-02cbc651ce06'}' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c334da-e0cd-42cc-952b-7d37ae8405d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 08:41:38 devstack cinder-volume[87179]: INFO cinder.volume.flows.manager.create_volume [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Volume volume-9a92c53e-9a67-4763-83f8-78bb807d42cf (9a92c53e-9a67-4763-83f8-78bb807d42cf): created successfully Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c334da-e0cd-42cc-952b-7d37ae8405d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87179) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 08:41:38 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Flow 'volume_create_manager' (d228b67e-4b24-49cb-a45d-300ea8a88ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87179) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 08:41:38 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-3011316f-06e4-4707-a700-c42a9bec484c tempest-SnapshotDependencyTests-1722452088 None] Created volume successfully. Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "cinder-b6ecc921-357a-4e98-ad95-02cbc651ce06-delete_snapshot" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-b6ecc921-357a-4e98-ad95-02cbc651ce06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "cinder-quobyte-6d0d5f6a-e254-4626-a67a-8559de3316bb" by "delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-6d0d5f6a-e254-4626-a67a-8559de3316bb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "cinder-quobyte-b6ecc921-357a-4e98-ad95-02cbc651ce06" by "_delete_snapshot" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-b6ecc921-357a-4e98-ad95-02cbc651ce06" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Deleting offline snapshot b6ecc921-357a-4e98-ad95-02cbc651ce06 of volume 6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] snapshot_file for this snap is: volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 {{(pid=87179) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[d813f229-2887-4626-8de0-62b859a433c3]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:41:39 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:39 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 Jul 07 08:41:39 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:40 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06" returned: 0 in 0.731s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:40 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.remotefs [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d0d5f6a-e254-4626-a67a-8559de3316bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87179) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 08:41:40 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[64113f1b-d8c5-47af-a18f-eebef84686d6]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:41:40 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:40 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb Jul 07 08:41:40 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:41 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb" returned: 0 in 0.718s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:41 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:41 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 Jul 07 08:41:41 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:42 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06" returned: 0 in 0.697s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:42 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06 Jul 07 08:41:42 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:42 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:42 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb.b6ecc921-357a-4e98-ad95-02cbc651ce06" returned: 0 in 0.621s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-b6ecc921-357a-4e98-ad95-02cbc651ce06" released by "_delete_snapshot" :: held 2.862s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-6d0d5f6a-e254-4626-a67a-8559de3316bb" released by "delete_snapshot" :: held 2.886s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:42 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Created reservations ['7846cf32-5490-406b-b6f5-ecf6d5ea7c4f', '750c1c6e-2819-468d-ab40-94c0ec0960dd', 'da244650-17a0-4484-8f34-98f88c636764', '3a8f432a-69da-4c4d-a82a-033f75871443'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:41:42 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Delete snapshot completed successfully. Jul 07 08:41:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-eebfc11e-58fd-4e25-bf87-72f37de46137 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-b6ecc921-357a-4e98-ad95-02cbc651ce06-delete_snapshot" released by "delete_snapshot" :: held 3.009s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "cinder-6d0d5f6a-e254-4626-a67a-8559de3316bb-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:42 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-6d0d5f6a-e254-4626-a67a-8559de3316bb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "cinder-quobyte-6d0d5f6a-e254-4626-a67a-8559de3316bb" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:43 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-6d0d5f6a-e254-4626-a67a-8559de3316bb" acquired by "delete_volume" :: waited 0.014s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:43 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba366aef-9c56-405c-9727-0a1bc7b8607f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:41:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:43 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb Jul 07 08:41:43 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:43 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb" returned: 0 in 0.760s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:43 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:43 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb Jul 07 08:41:43 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:44 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-6d0d5f6a-e254-4626-a67a-8559de3316bb" returned: 0 in 0.612s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:44 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-6d0d5f6a-e254-4626-a67a-8559de3316bb" released by "delete_volume" :: held 1.424s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:44 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Created reservations ['72ebf900-f687-4c68-b7be-5d75ea4d4212', '48b65b5f-182b-4573-a2f2-2653a22780e4', 'bcba06a6-aba1-4440-aba9-689b679ee2c7', '6988b208-81e9-491e-984f-6e45d0cbcbbb'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:41:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:41:44 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:41:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:44 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:44 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:41:44 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "cinder-9a92c53e-9a67-4763-83f8-78bb807d42cf-delete_volume" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-9a92c53e-9a67-4763-83f8-78bb807d42cf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:45 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.648s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:45 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:41:45 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Deleted volume successfully. Jul 07 08:41:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-b3fd4e7e-9d20-4247-a120-f4445aa63201 tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-6d0d5f6a-e254-4626-a67a-8559de3316bb-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "cinder-quobyte-9a92c53e-9a67-4763-83f8-78bb807d42cf" by "delete_volume" {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 08:41:45 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-9a92c53e-9a67-4763-83f8-78bb807d42cf" acquired by "delete_volume" :: waited 0.013s {{(pid=87179) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 08:41:45 devstack cinder-volume[87179]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68bc9de-89c6-4af0-816d-8fc058905c4f]: (4, 'qcow2') {{(pid=88107) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 08:41:45 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:45 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf Jul 07 08:41:45 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:46 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf" returned: 0 in 0.758s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:46 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf Jul 07 08:41:46 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:46 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3/volume-9a92c53e-9a67-4763-83f8-78bb807d42cf" returned: 0 in 0.622s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-quobyte-9a92c53e-9a67-4763-83f8-78bb807d42cf" released by "delete_volume" :: held 1.417s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG cinder.quota [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Created reservations ['ae1caee9-cca2-46f0-b04c-dfa5b3ec56f8', 'b73cc547-3563-435e-9d40-c50464344b3d', '502350f2-3852-49d4-84cc-5c5ed987df89', '791562fc-18bb-48fc-bdab-791390a6be29'] {{(pid=87179) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:41:46 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:41:46 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:41:46 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:41:47 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 07 08:41:47 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.651s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:41:47 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:41:47 devstack cinder-volume[87179]: INFO cinder.volume.manager [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Deleted volume successfully. Jul 07 08:41:47 devstack cinder-volume[87179]: DEBUG cinder.coordination [None req-aef569fd-0818-4a78-8444-c96c8527dcfa tempest-SnapshotDependencyTests-1722452088 None] Lock "cinder-9a92c53e-9a67-4763-83f8-78bb807d42cf-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=87179) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 08:41:56 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:UPDATE=29,cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:41:57 devstack cinder-volume[87179]: DEBUG dbcounter [-] [87179] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=87179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 08:42:04 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:42:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 08:42:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 08:42:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959': None} {{(pid=87179) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 08:42:04 devstack cinder-volume[87179]: DEBUG cinder.volume.drivers.quobyte [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d5dff9c9-1361-4516-a365-8f7424d08959'] {{(pid=87179) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 08:42:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.lockutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87179) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 08:42:04 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 08:42:04 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3 Jul 07 08:42:04 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 08:42:05 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Jul 07 08:42:05 devstack cinder-volume[87179]: DEBUG oslo_concurrency.processutils [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/091377f81ee32bdc61ba45081dc53ff3" returned: 0 in 0.665s {{(pid=87179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 08:42:05 devstack cinder-volume[87179]: DEBUG cinder.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Notifying Schedulers of capabilities ... {{(pid=87179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 08:42:05 devstack cinder-volume[87179]: DEBUG oslo_service.periodic_task [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] Running periodic task VolumeManager._thread_info {{(pid=87179) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 08:42:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread count: 28 {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 08:42:05 devstack cinder-volume[87179]: DEBUG cinder.volume.manager [None req-87270eb7-9e0e-4936-843c-a4b520791046 None None] thread info: [<_MainThread(MainThread, started 126224939061376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87179) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}